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ABSTRACT 


Under  this  contract  a  number  of  topics  have  been  studied  and 
analyzed  in  detail  in  order  to  bring  together  and  scmewhat  extend 
the  concepts  of  communi cation  theory  as  they  apply  to  some  current 
problems  in  digital  communication  systems. 

Radio  wave  channels  are  characterized  by  a  model  which  accounts 
for  both  multiplicative  and  additive  disturbances.  A  large  amount  of 
experimental  data  pertaining  to  radio  disturbances  is  evaluated  and 
correlated.  The  importance  of  the  Rayleigh  fading  channel  is  emphasized 
and  previous  work  is  extended  to  determine  the  capacity  and  efficiency 
of  the  Rayleigh  channel. 

Detection  theory  concepts  have  been  extended  to  treat  the  problem 
of  signal  detection  in  the  presence  of  statistically  unknown  additive 
disturbances.  Several  detectors  baaed  on  nan-parametric  statistical 
techniques  are  treated  in  detail.  These  detectors  are  compared  to  the 
conventional  likelihood  detectors.  Design  procedures  are  formulated. 

Signal  design  techniques  are  used  to  optimize  transmitted  wave¬ 
forms  and  the  improvement  in  system  performance  is  determined.  The 
criterion  used  in  this  analysis  is  the  minimization  of  intersymbol 
influence  and  the  minimization  of  transmitter  power  for  a  fixed  pro¬ 
bability  of  received  errors. 

The  tradeoffs  available  between  transmitter  power  and  coding 
complexity  are  thoroughly  investigated  for  the  binary  symmetric  channel. 
Results  are  obtained  for  both  Hamming  and  Bose-Chandhuri  codes. 

Recommendations  for  further  work  in  promising  areas  are  made.  The 

need  to  supplement  theoretical  work  with  experimental  work  is  pointed  out. 
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I  under  no  signal  conditions 

z  slgnal-to-noise  ratio 

z  average  slgnal-to-nolse  ratio 
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p(y) 

Pz(y) 

pz(y) 

yi 

E  [U  ] 
mn 

EJU  ] 
z  mn 

C»—  [U  ] 
ol  mn 

^l[U  ] 
z  mn 

K 

n 

m 

a 

P 

U 

mn 

V,u 


N 

IT 

M 

l 

1=1 

E(U) 


probability  density  function  of  T  under  no  signal 
conditions 

probability  distribution  function  of  T  under  signal 
conditions  (z/o) 

probability  density  function  of  T  under  signal 
conditions 

samples  from  the  randca  process  (T) 

mean  of  the  random  variable  U  under  no  signal 
conditions 

mean  of  the  random  variable  U  under  signal  conditions 

q)1 

standard  deviation  of  U  under  no  s5gnal  conditions 

mn 

standard  deviation  of  U  tinder  signal  conditions 

mn 

a  constant 

number  of  samples  from  (T(t)) 
number  of  samples  from  Nf(t) 
probability  of  false  alarm 
probability  of  false  dismissal 
teat  statistic 

asymptotic  relative  information  efficiency  of  detector 
U*  with  respect  to  the  detector  U 

threshold  value;  a  value  of  the  test  statistic  U  resulting 
in  a  false  alarm  probability  a 

likelihood  ratio 

product  of  N  terms 


summation  of  M  terms 

efficacy  of  the  test  statistic  U 
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I 

*&) 


P 

e 

Kan 

Tn(y) 

SB(y) 


\n 


R* 

rnn 


ran 


■l 


a 


d 

e^t) 

eo(t) 

ex(t) 


probability  density  of  the  Gaos  elan  randan  variable  y 
under  no  signal  conditions 

noise  standard  deviation 

probability  density  of  the  Gaussian  random  variable 
Y  under  signals  conditions 

optimum  test  statistic  for  the  D-C  detection  problem 

optimum  test  statistic  for  the  noncoherent  detection 
problem 

the  Mann- Whitney  test  statistic 

the  sum  of  the  false  alarm  and  false  dismissal  pro¬ 
babilities 

the  KoImogoror-SbtLraov  test  statistic 

empirical  distribution  function  of  the  saiqple  y, . .  .y 

±  n 

empirical  distribution  function  of  the  sample  y  . .  .y 

J.  HI 

a  threshold  value  of  Xhn  resulting  In  false  alarm 
probability  a 

a  rank  test  statistic 

the  rank  statistic  for  the  D-C  detection  problem 

the  rank  statistic  for  the  noncoherent  detection 
problem 

hypothesis  of  signal  being  absent 

hypothesis  of  signal  being  present 

pulse  duration 

constants 

time  duration 

pulse  duration 

input  signal  (into  channel) 

output  signal  (from  channel) 

a  pulse  waveform 
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hA  coefficients 

b  1(t)  unit  step  response  of  network 

J  V- 1 

k^  coefficients 

s  transform  variable 

u(t)  unit  step  function 

C  capacitance 

D(s)  polynomial  in  s 

denominator  of  an  expression 
E^(s)  Laplace  transform  of  e^(t) 

G  (s)  a  certain  class  of  entire  functioning 
H(s)  network  transfer  function 

L  inductance 

H(s)  polynomial  in  s 

numerator  of  an  expression 
P^s)  polynomial  in  s 

R  resistance 

a  inverse  time  constant 

^  inverse  time  constant 

poles  of  a  transfer  function 
6  variation 

T|  pulse  transmission  efficiency 

r)p  optimum  pulse  transmission  efficiency 

X  characteristic  value 

A.  number  of  received  error  patterns,  weight  «=J,  for  which 

the  corrected  word  contains  a  given  specific  blnit  in 
error;  independent  of  the  binit  chosen 
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E 
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<*4> 


la 


n,  H 

n' 

P 


K 


‘i 

*1 


number  by  which  reference  it  made  to  a  specific  binit 
In  the  code  word 

energy  per  binit 

XL 

number  of  the  J  hlnit  In  error  In  the  received  word 

set  of  all  binits  in  error  In  the  received  word; 

(«1,  eg,  . ..,  e^),  when  the  word  contains  1  errors 

as  for  ty  (e^ ),  hat  at  the  decoder  output 

number  of  information  binits  In  a  code  word 

number  of  error  patterns  (e.)  of  weight  1  In  a 

Hawing  code  word  for  whlch^each  of  the  corresponding  (e ' ) 

have  weight  1+1  0 

as  for  for  which  the  weight  of  each  (e^ )  is  1-1 

as  for  L^,  for  which  the  weight  of  each  (ep  is  1 

as  for  L. ,  for  which  de(e'),  where  d  is  an  information 

binit  1  J  “ 

as  for  I.  .  with  the  added  condition  that  (e.)  is  such 
lot  J 

that  y=l  (see  "y"  below) 

length  of  a  Hamml  ag  SBC  code  word;  **  2m-l,  m  =  positive 
integer.  "H"  is  used  an  figures;  "n"  is  used  in  text. 

length  of  a  Hamming  SEC/KD  code  word;  *  n  +  1 

channel  binit  error  probability 

decoder  output  binit  error  probability 

indicator,  Haanirg  SEC/BED  codes;  =  1  if  the  received 
word  is  retained,  <  0  if  the  received  word  is  discarded 

indicator,  Hamming  SEC/BED  codes;  »  1  if  the  overall 
check  blnit  is  received  in  error;  =  0  ir  the  overall 
check  binit  is  received  correctly 

binary  sequences;  possible  received  words 

code  words 

vector,  modulo  2,  addition 
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CHAPTER  I 


nxROsucnoH 

A  study  of  advanced  Co— nnl  cation  Theory  Techniques  was  undertaken 
"by  the  Cc—uni cation  Sciences  Laboratory  of  Purdue  University  for  the 
Aeronautical  Systems  Division,  Wright  Patterson  Air  Porce  Base  during 
February  1962.  The  purpose  of  this  program  vas  to  help  unify  present 
diversified  aspects  of  statistical  ccnmuni  cation  theory,  stressing  the 
interrelation  which  exists  between  information,  decision  and  coding 
theories . 

The  major  emphasis  of  this  research  is  placed  on  the  connecting 
of  a  number  of  theories  to  stress  the  roles  which  they  play  In 
determining  the  performance  of  a  communication  system.  Although  the 
major  portion  of  this  study  was  originally  to  be  a  collecting,  simpli¬ 
fying,  and  integration  of  previous  studies  into  a  gross  framework,  it 
soon  became  apparent  that  considerable  extensions  were  needed  in  a 
number  of  areas  before  this  could  be  accomplished.  Pour  primary  areas 
of  Investigation  were  chosen  for  further  study.  These  Include: 
a)  a  discussion  of  channels,  their  characteristics  and  capacities,  b)  the 
vise  of  non-likelihood  detection  to  combat  non- Gaussian  noise  sources, 
c)  the  application  of  signal  design  techniques  to  channels  which  have 
memory,  and  d)  the  trade-off  in  system  parameters  In  a  coded  system. 

This  report  contains  the  results  of  studies  made  in  the  above  areas . 
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The  principal  problems  and  results  derived  from  this  study  are  sum¬ 
marized  in  this  first  chapter.  The  detailed  discussion  is  presented  in 
the  remaining  chapters  of  the  report. 

1.1  Channel  Characterization 

The  characterization  of  radio  wave  channels  is  treated  in  detail  in 
Chapter  II.  A  simple  model,  useful  in  analysis,  is  presented  which  accounts 
for  degradation  in  the  received  signal  in  terms  of  both  multiplicative 
and  additive  disturbances.  Additive  and  multiplicative  disturbances  com¬ 
monly  encountered  in  typical  channels  are  discussed.  The  importance  and 
applicability  of  the  Rayleigh  fading  channel  is  pointed  out.  The  chapter 
brings  together  and  correlates  a  great  deal  of  experimental  data  and 
results  that  were  previously  only  to  be  found  scattered  throughout  the 
technical  literature. 

1.2  Capacity  of  the  Rayleigh  Jading  Channel 

In  Chapter  III  the  capacity  of  the  Rayleigh  fading  channel  is  derived. 
The  results  are  compared  with  the  capacity  of  the  'nity  gain  channel  for 
different  received  signal- to-nolse  power  ratios.  In  order  to  compare  the 
Rayleigh  channel  to  other  channels,  the  efficiency  factor  p  (defined  as  the 
required  received  energy  per  Information  bit  received  in  the  presence  of  a 
alven  Gaussian  disturbance)  is  also  evaluated. 

1.3  Hon-parametrlc  Detection 

The  problem  of  detection  of  a  signal  in  noise  of  known  statistical 
properties  has  been  investigated  thoroughly  in  the  past.  However,  these 
methods  are  completely  inapplicable  and  Inappropriate  whenever  these 
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noise  statistics  are  unknown.  In  Chapter  IV  a  detection  criterion  based 
on  the  methods  of  non-paramo tri c  statistics  Is  utilized  that  pemlts  the 
design  of  detectors  on  the  basis  of  much  less  a-priori  information .  Several 
detectors  based  on  this  detection  criterion  are  Investigated  and  their 
properties  obtained.  A  comparison  between  the  optimal  (likelihood)  de¬ 
tectors  and  these  nev  (non-likelihood)  detectors  is  made  on  the  basis  of 
information  efficiency.  Also,  a  practical  design  procedure  Is  formulated 
for  the  design  of  these  nev  (non- likelihood)  detectors. 

1.4  Optimization  of  Signaling  Waveforms 

In  Chapter  V  the  application  of  Signal  Design  to  digital  ccssmni ca¬ 
tions  is  considered.  This  essentially  Involves  two  basic  questions: 

(l)  how  can  the  transmitted  waveforms  be  optimized;  and  (2)  how  much 
Improvement  In  system  performance  may  be  achieved  In  this  manner.  It  is 
pointed  out  that  many  factors  combine  to  determine  the  best  signal  to  be 
transmitted  In  any  particular  situation,  among  these  being  the  character¬ 
istics  of  the  channel  and  the  criterion  of  performance. 

In  the  work  performed  thus  far,  a  dispersive  channel  with  additive 
Gaussian  noise  is  considered.  Radio  transmissions  through  -  or  reflected 
or  scattered  by  -  the  ionosphere  are  examples  of  such  channels,  where  the 
dispersive  nature  arises  from  the  existence  of  sane  continuous  range  of 
path  lengths  through  the  inhomogeneous  medium  due  to  finite  antenna  aper¬ 
tures.  Digital  cctmsunl cation  over  such  channels  is  usually  limited  to 
certain  marl  mum  transmission  rates  because  the  transmitted  pulses  appear 
smeared  out  at  the  receiver  and  thus  require  at  leaat  a  certain  artrHuw 
spacing  to  be  distinguishable  at  the  receiver .  The  performance  criterion 
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which  Is,  therefore,  applied  to  the  Signal  Design  problem  Is  the  minimiza¬ 
tion  of  intersymbol  interference  and  the  minimization  of  transmitter  power 
required  for  a  specified  probability  of  received  errors. 

In  order  that  numerical  results  may  be  obtained,  a  particular  channel 
model  is  considered  on  which  most  of  the  discussion  in  the  chapter  is  based. 
Die  method  of  approach  is  quite  general,  however,  and  the  results  obtained 
indicate  the  advantages  to  be  gained  by  the  proper  design  of  signals. 

1.5  Performance  of  Error  Correcting  Codes 

Chapter  VI  deals  with  a  quantitative  analysis  of  the  relative  advan¬ 
tages  of  increases  in  transmitted  power  versus  the  use  of  error-correcting 
codes  for  binary  symmetric  channels .  This  analysis  is  subdivided  into  three 
major  sections.  The  first  section  deals  with  the  characterization  of 
binary  ccromml cations  channels  by.  the  transitional  or  error  probabilities, 
given  the  signal-to-noise  ratio  at  the  receiver  and  the  modulation  system 
used;  the  channel  disturbances  are  restricted  to  additive'  white  Gaussian 
noise . 

The  second  section  considers  the  determination  of  the  bit  error  pro¬ 
bability  at  the  decoder  output  as  a  function  of  the  channel  error  probability 
and  the  code  characteristics.  The  analytically  derived  expression  for 
Hamming  codes  is  entirely  new;  the  proof  of  the  derivation  is  Included  as 
Appendix  IV. 

The  final  section  presents,  in  graphical  and  tabular  form,  detailed 
results  for  the  error  rates  and  figures  of  merit  for  Hamming  codes,  based 
upon  both  constant  transmitted  binit  rate  and  constant  information  binit 
rate.  The  results  obtained  by  computer  analysis  for  two  of  the  shorter 
multiple-error  correcting  Bose-Chandhurl  codes  are  also  presented. 
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1.6  Recosmendatlons 

The  final  chapter  of  this  report  brings  together  the  results  and 
recamnendations  of  the  problems  considered  in  this  effort.  Areas  that 
look  particularly  prcnlslng  are  discussed  In  greater  detail  and  specific 
recommendations  for  continued  study  and/or  experimental  phases  are  made. 
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CHAPXER  II 

CHAHHEL  CHARACTERIZATIOH 


2 .1  Introduction 

The  specification  and  design  of  a  reliable  communication  system 
requires  fairly  accurate  knowledge  of  the  channel  through  which  one  desires 
to  transmit  signals.  In  the  past  a  large  variety  of  different  types  of 
channels  have  been  used  for  radio  wave  propagation.  A  partial  listing 
is  given  below: 

a)  Ground-wave  systems 

b)  Line -of- sight  systems 

c)  Systems  employing  reflection  from  the  ionosphere 

d)  Ionospheric-scatter  systems 

e )  Meteor- trail- reflection  systems 

f)  Beyond- line - of- sight  systems  employing  diffraction 

g)  Tropospheric- scatter  systems 

Although  the  transmission  characteristics  of  these  channels  vary  widely, 
the  staple  model  shown  in  Fig.  2.1  can  be  used  to  analyze  the  performance 
of  each  of  the  channels.  Note  that  the  amplitude  and  phase  distortion 


FIGURE  2.1 

experienced  by  the  transmitted  signal,  s(t),  is  attributed  to  both  the 
multiplicative  disturbance,  A(t)€*^^,  and  the  additive  noise,  n(t). 
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This  chapter  presents  a  brief  surrey  of  the  types  of  additive  and  multi¬ 
plicative  disturbances  commonly  encountered  In  typical  channels. 

2 .2  Additive  Disturbances 

Additive  noise  Is  frequently  assumed  to  be  Gaussian.  Tor  many  systems 
the  Gaussian  assumption  appears  to  be  a  good  one.  Yet,  there  are  many  other 
systems  (for  example,  those  vhich  employ  ionospheric  channels)  In  which  the 
Gaussian  assumption  does  not  lead  to  a  satisfactory  prediction  of  system 
performance . 

A  literature  survey  on  the  statistical  characterization  of  radio  noise 
revealed  that  Intensive  work  In  this  area  has  Just  begun,  most  of  it  haring 
been  carried  out  vithin  the  last  four  or  five  years.  The  Initial  meas¬ 
urements  have  been  made  at  frequencies  below  10  mc/s.  Very  little  data  Is 
available  above  this  frequency.  The  statistical  data  vhich  has  been  ob¬ 
tained  thus  far  pertains  to  the  envelope  of  the  noise  as  measured  by  a 
linear  envelope  detector,  and  not  to  the  noise  Itself.  Since  a  knowledge 
of  the  statistics  of  the  envelope  is  not  sufficient  to  deduce  the 
statistics  of  the  noise,  much  more  statistical  data  remains  to  be  taken 
before  the  noise  can  be  adequately  characterized  so  as  to  enable  accurate 
prediction  of  system  performance. 

Badlo  noise  falls  Into  several  categories.  The  most  usual  types  of 
additive  noise  encountered  are: 

a)  thermal  noise 

b)  man-made  noise 

c)  noise  from  precipitation,  blowing  snow  or  dust 

d)  noise  from  corona 

e )  atmospheric  noise 

Each  of  these  types  of  noise  is  briefly  discussed  In  the  following  sections. 
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2.2.1  Thermal  Boise ^  2'  ^ 

Tran.  thermodynamical  reasoning  It  can  be  shown  that  all  materials 
which  are  capable  of  absorbing  radiation  are  sources  of  thermal  noise. 

In  fact,  good  absorbers  of  radiation  are  good  thermal  noise  sources  while 
poor  absorbers  of  radiation  are  poor  sources  of  thermal  noise.  Hence, 
thermal  noise  Is  generated  by  the  ground,  the  troposphere,  the  ionosphere, 
and  extra-terrestrial  sources. 

While  the  ground  may  act  as  a  good  reflector  of  radio  waves  at 
glancing  Incidence,  this  is  typically  not  true  at  steeper  angles  of 
incidence,  particularly  for  vertical  polarization,  The  two  obvious  ways 
of  reducing  ground  noise  (which  Is  rarely  serious  below  about  200  mc/s) 
are  to  limit  the  sensitivity  of  the  antenna  in  the  direction  ox  the 
ground,  and  to  Increase  the  reflection  coefficient  of  the  ground.  The 
former  may  be  achieved  by  minimizing  side  lobes  in  the  downward  direction; 
the  latter  may  be  achieved  by  using  an  artificial  ground  plane  of  radial 
vires,  or  mesh,  or  In  special  cases  by  taking  advantage  of  the  very  high 
reflection  properties  of  sea  water. 

Under  some  circumstances,  and  particularly  at  wavelengths  less  then 
about  1.^  cm,  the  troposphere  can  act  as  an  absorbing  medium.  The  two 
atmospheric  constituents  responsible  for  this  absorption  are  water  vapor 
and  oxygen. 

VH T  radio  waves  can,  under  certain  circumstances,  undergo  significant 
absorption  in  the  ionosphere;  on  these  occasions  the  Ionosphere  will  act 
as  a  source  of  thermal  noise.  Since  the  number  of  decibels  of  attenuation 
in  the  ionosphere  at  VHP  is  proportional  to  ~  ,  the  Ionosphere  contri- 

r 

bution  to  thermal  noise  tends  to  decrease  rapidly  with  Increasing  frequency. 


Extra-terrestrial  thermal  noise  originates  from  the  various  galaxies, 
the  sun,  the  noon,  and  the  planets.  Galactic  noise  looses  a  very  important 
limi  tation  to  cantnuni cation  systems  in  the  HE  and  VHE  hands  (3  -  300  mc/s). 
The  intensity  of  thermal  noise  generated  by  the  sun  varies  considerably, 
especially  in  the  VHF  band,  and  during  years  of  high  sunspot  number.  The 
contributions  due  to  lunar  and  planetary  thermal  noise  are  likely  to  be 
negligible  compared  to  that  of  the  sun. 

2.2.2  Man-Made  Holse^1*  ^ 

Man-made  noise  is  generated  by  almost  all  types  of  electrical  de¬ 
vices  and  machinery.  Since  it  is  almost  always  propagated  along  power  lines 
or  by  groundvave,  the  propagation  is  not  affected  appreciably  by  ionospheric 
conditions.  However,  there  is  some  experimental  evidence  that  man-made 
noise  may  also  be  received  from  distant  sources  via  ionospheric  propaga¬ 
tion. 

The  noise  is  usually  impulsive  in  nature.  When  many  sources  are  In¬ 
volved,  the  envelope  probability  density  is  similar  to  that  of  atmospheric 
noise.  However,  the  dynamic  range  is  usually  considerably  less  than  that 
encountered  in  atmospheric  radio  noise.  The  radiated  energy  often  has 
strong  components  which  extend  feu:  into  the  radio- frequency  spectrum  (up 
to  tens  of  megacycles  per  second). 

2.2.3  Boise  From  Precipitation.  Blowing  Snow  or  Dust,  and  Corona 

The  radio  noise  caused  by  precipitation,  blowing  snow,  or  blowing 
dust  or  sand  is  the  result  of  charged  particles  actually  hitting  the 
antenna.  These  particles  become  charged  as  they  move  through  the  air,  and 
as  these  contact  the  antenna,  the  charge  is  transferred  to  the  antenna. 
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Corana  noise  Is  caused  by  the  presence  of  a  low,  highly-charged  cloud 
passing  over  the  antenna,  causing  an  actual  corona  discharge  at  the  tip 
of  the  antenna.  Hot  much  Is  known  quantitatively  about  the  levels  en¬ 
countered  under  these  two  conditions.  When  these  conditions  have  been 
observed  at  various  noise  recording  stations,  the  level  of  the  noise  has 
increased  on  all  frequencies  up  to  20  mc/s  to  the  top  of  the  recorder 
scale,  which  has  been  in  several  cases  as  much  as  50  db  above  the  level 
prior  to  the  occurrence  of  the  phenomenon. 

2.2.4  Atmospheric  Hoise^1*  ^ 

The  principal  sources  of  atmospheric  noise  are  the  lightning  dis¬ 
charges  which  occur  during  thunderstorms.  Approximately  44,000  thunder¬ 
storms  occur  somewhere  In  the  world  every  day.  Due  to  these  storms  there 
occur  on  the  average  100  lightning  strokes  per  second.  The  amount  of 
charge  involved  In  a  lightning  stroke  Is  about  10  coulombs  and  the  peak 
current  is  in  the  region  of  50,000  amperes.  Lightning  energy,  like  ordinary 
radio  signals,  reaches  a  receiver  by  all  of  the  well-known  mechanisms  of 
propagation,  including  surface  wave,  tropospheric  wave,  and  ionospheric 
sky  wave.  In  addition,  there  is  the  whistler'  mode  of  propagation  for  fre¬ 
quencies  below  35  kc/s  in  which  the  lightning  energy  is  guided  by  the 
earth's  magnetic  lines  of  force  up  to  distances  half  way  around  the  world. 
The  spectrum  of  the  radiated  energy  covers  a  wide  frequency  range,  from  as 
low  as  a  few  cycles  to  tens  of  megacycles  per  second. 

A  typical  amplitude  probability  density  distribution  of  an  atrnos- 

(9) 

pheric  noise  envelope  Is  shown  in  Fig.  2.2'^.  The  coordinates  are  plotted 
as  noise  level  In  decibels  above  the  root  mean  square  voltage  versus  the 
percentage  of  time  that  each  level  is  exceeded.  Rayleigh  graph  paper  is 
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PERCENT  TIME  ORDINATE  IS  EXCEEDED 


FIGURE  2.2 

A  TYPICAL  AMPLITUDE  PROBABILITY  DENSITY  DISTRIBUTION 
OF  AN  ATMOSPHERIC  NOISE  ENVELOPE 
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used  so  that  a  distribution  of  the  form 

P(X^x)  =  e"** 

plots  as  a  straight  line  with  a  negative  slope  of  j.  In  particular, 

the  Rayleigh  distribution  plots  as  a  straight  line  with  a  slope  of  -  l/2. 

The  lower  portion  of  the  curve,  representing  low  voltages  and  high 
probabilities,  is  composed  of  many  random  overlapping  events,  each  con¬ 
taining  only  a  small  portion  of  the  total  energy*  The  Central  Limit  Theorem 
states  that  if  several  independent  events  of  this  type  are  superimposed,  the 
sum  tends  rapidly  to  a  Gaussian  process  as  the  number  of  components  (of 
roughly  equal  power)  is  increased.  Hence,  we  would  expect  the  lower  portion 
of  the  curve  to  approach  a  Rayleigh  distribution  since  the  envelope  of  a 
Gaussian  process  is  Rayleigh. Biis  is  seen  to  be  the  case,  the  slope 
of  the  lower  portion  of  the  curve  being  very  close  to  -  l/2. 

The  section  representing  very  high  voltages  exceeded  with  low  pro¬ 
babilities  is,  in  general,  composed  of  nonoverlapping  large  pulses  occur¬ 
ring  infrequently.  From  experimental  measurements  of  atmospheric  noise 
distributions,  this  section  has  been  found  to  be  well  represented  by  a 
straight  line  on  Rayleigh  graph  paper  with  values  of  m  in  the  range  from 
+0.1  to  +0.4/12^ 

On  this  graph  paper,  the  remaining  section  of  the  distribution  has 
been  found  to  correspond  quite  closely  to  an  arc  of  a  circle  tangent  to 
the  above  two  straight  lines.  The  National  Bureau  of  Standards  has 
developed  a  graphical  method  for  constructing  the  entire  envelope  ampli¬ 
tude  probability  distribution  from  only  three  measured  statistical 
(9) 

moments.  7 

The  dynamic  range  of  the  distribution,  as  measured  between  the 
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0.0001  per  cent  and  99  P«r  cent  Intercepts,  has  "been  observed  to  vary  from 
a  low  of  59  db  to  a  high  of  102  db.  An  average  dynamic  range  appears  to 
he  around  73  db.  Bie  variations  In  dynamic  range  for  frequencies  above 
35  kc/s  agree  with  expectations  based  on  the  distribution  of  distances  to 
thunderstorms  where  It  Is  apparent  that  small  dynamic  ranges  will  result 
If  the  range  of  distances  to  the  effective  thunderstorms  Is  small.  The 
above  statement  does  not  necessarily  hold  for  frequencies  below  35  kc/s 
because  of  the  whistler  mode  of  propagation. 

The  envelope  amplitude  distributions  for  the  highest  and  lowest 
observed  average  power  levels  show  a  difference  of  46  db  between  the 
root  mean  square  values  of  voltage.  The  high- lev®  1  curve  was  obtained 
on  a  day  with  a  large  number  of  local  afternoon  mountain  thunderstorms 
while  the  low-level  curve  was  obtained  during  the  morning  of  a  relatively 
quiet  day. 

It  should  be  pointed  out  that  the  distributions  mentioned  above  are 
strictly  valid  only  for  the  bandwidth  In  which  the  measurements  are  made. 
Typical  bandwidth s  used  were  on  the  order  of  1100  cycles  per  second.  The 
principal  effects  of  reducing  the  predetection  bandwidth  are  a  reduction 
in  the  dynamic  range  with  a  greater  and  greater  portion  of  the  distribution 
curves  becoming  a  straight  line  of  slope  equal  to  -  l/2.  Measurements  in 
an  0.2  cycle  band  yielded  a  Rayleigh  distribution  over  the  entire  range 
measured.  These  results  are  reasonable  since  as  the  observing  bandwidth 
is  reduced,  the  energy  from  all  the  received  Impulses  is  spread  out  over 
a  greater  period  of  time  with  a  resulting  decrease  In  the  amplitudes  of 
the  Impulses. 

Generally,  the  additive  noise  encountered  an  ionospheric  channels  is 
atmospheric  noise.  Montogmery  has  shown  that  in  a  binary  narrow-band 
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frequency  modulation  system  the  errors  can  1)0  calculated  as  one-half  the 
probability  of  the  noise  envelope  exceeding  the  carrier  envelope.  Hence, 
the  envelope  statistics  described  above  can  be  used  in  calculating  the 
probability  of  error  for  a  narrow-band  PSK  system  utilizing  an  ionospheric 
channel.  Experimental  curves  have  been  obtained  which  overlap  the  theore¬ 
tical  curves  quite  closely.  Pig.  2.3  shows  the  large  discrepancies  which 
can  occur  in  system  performance  if  Gaussian  noise  is  assumed  rather  than 
atmospheric  noise.  For  signal- to-nolse  ratios  larger  than  6  db  the  error 
rates  experienced  with  atmospheric  noise  are  much  larger  than  those 
experienced  with  Gaussian  noise. 

2.2.5  Concluding  Remarks 

The  Gaussian  assumption  is  likely  to  be  a  good  one  for  thermal  noise 
internal  to  the  receiving  system,  solar,  lunar,  planetary,  and  cosmic 
noises.  In  terms  of  frequencies,  all  noise  above  150  mc/s  can  usually  be 
assumed  to  be  Gaussian.  It  should  be  pointed  out  that  above  300  me/ s 
the  thermal  noise  generated  internally  in  the  receiving  system  is  usually 
the  controlling  noise.  Between  30  and  150  mc/s  the  major  noise  is  most 
often  of  galactic  origin.  Below  30  mc/s  atmospheric  noise  and  man-made 
noise  predominate  over  the  other  types  of  noise  for  a  greater  percentage 
of  the  time.  This  is  shown  in  Pig.  2.4. 

2.3  Multiplicative  Disturbances 

Multiplicative  disturbances  are  responsible  for  such  phenomena  as 
fading,  dispersion,  multipath,  phase  distortion,  and  time  delay.  Since 
these  disturbances  vary  widely,  depending  upon  the  frequency  of  the  trans¬ 
mitted  radio  wave,  they  are  most  easily  discussed  by  making  reference  to 
the  pertinent  frequency  bands. 


ATMOSPHERIC  N0I3E 


EFFECTIVE  ANTENNA  NOISE  FIGURE 


FIGURE  Z.k 

RADIO  NOISE  MEASUREMENTS  DURING  IOY 
GUNBARREL  HILL,  COLORADO 
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2.3.1  3-30  ltc/a  TLF^1^ 

VLF  propagation,  occurring  in  the  form  of  waveguide  modes  between  the 
earth  and  the  ionosphere,  is  often  referred  to  as  ducting.  Propagation  in 
the  VLF  range  is  characterized  hy  low  attenuation  to  very  great  distances, 
with  great  reliability  and  stability  of  transmission.  Because  of  the 
large  physical  structure  required  for  transmitting  antennas  (one  wave¬ 
length  is  30  kilometers  at  10  kc/s)  antennas  are  electrically  small,  and 
either  costly  or  inefficient.  The  Q  of  many  typical  transmitting  antenna 
systems  in  this  frequency  range  limit  the  modulation  bandwidth  to  less  than 
100  cps. 

The  amplitude  of  VLF  signals  is  highly  variable  at  short  distances. 

The  amplitude  also  has  a  tendency  to  change  rapidly  during  the  period  of 
sunrise  or  sunset  along  the  path.  At  these  distances,  the  amplitude 
generally  goes  through  a  rapid  maximum  or  minimum,  before  tending  toward 
the  more  steady  value  characteristic  of  midday  or  midnight. 

At  distances  beyond  about  1000  km,  attenuation  is  typically  2  to  k 
decibels  per  1000  km.  Penetration  of  VLF  energy  into  conducting  earth 
or  even  sea  water  makes  the  frequency  range  useful  for  communication 
between  buried  antennas  or  submarines.  The  constancy  of  phase  of  the 
received  signal  at  distances  beyond  about  500  km  allovB  communl  cation 
systems  to  use  stored  reference  phase  information. 

VLF  systems  ere  commonly  used  for  reliable  long-range  communication, 
navigational  aids,  and  frequency  and  timing  standards. 

2.3.2  30-300  kc/s  LF^1^ 

The  LF  spectrum  Is  characterized  "by  higher  path  attenuation,  lower 
background  noise  levels,  and  more  stable  propagation  time  delays  relative 
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to  VLF  paths.  Transmitting  power  and  antenna  requirements  are  appreciably 
less  than  those  of  the  usual  VU  station,  and  In  addition  the  bandwidth s 
available  are  greater.  The  higher  path  attenuation  results  from  the  fact 
that  as  the  frequency  Increases,  the  Ionosphere  behaves  less  and  less  as 
a  sharp  boundary.  Hence,  the  radio  waves  reach  the  receiver  only  after 
they  have  penetrated  Into  the  ionosphere  and  lost  energy  in  absorption. 

The  fading  speed  and  the  depth  of  fading  depend  on  the  frequency, 
the  transmission  distance,  and  the  time  of  day.  During  the  daytime  the 
amplitude  is  substantially  constant.  The  fading  during  the  nighttime 
Is  much  more  Irregular.  The  amplitude  fluctuations  sue  approximately 
Rayleigh  but  assume  large  values  more  often  than  would  be  expected  on  a 
Rayleigh  distribution. 

As  with  VLF  the  transmitting  Installations  are  characterized  by  their 
large  physical  size  and  high  construction  and  maintenance  costs.  LF 
waves  are  not  adversely  affected  during  periods  of  Ionospheric  disturbance 
and  the  phase  stability  of  transmission,  permitting  frequency  comparison 
within  a  few  parts  In  10^,  makes  possible  long  range  radio  navigation 
utilizing  phase  comparison  between  spaced  phase-locked  transmitters. 

2.3.3  300  kc/s  —  3  mc/s  MF^ 

The  medium  frequency  range  is  a  transition  range  in  which  the 
Importance  of  the  ground  ware  at  the  lower  frequencies  gives  way  to  the 
Importance  of  the  sky  wave  at  the  higher  frequencies.  Ground-wave  attenu¬ 
ation  Increases  with  frequency,  so  that  In  the  higher  part  of  the  frequency 
range  only  short  distance  services  are  possible,  especially  over  paths  of 
poor  conductivity. 
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Sky-wave  propagation  via  the  E  and  F  region#  of  the  Ionosphere  Is 
lnportant  mainly  only  daring  the  night  hours;  It  Is  sometimes  observable 
fluring  daytime,  but  la  usually  highly  absorbed  In  the  D  region  of  the 
Ionosphere.  Transmission  In  this  frequency  range,  especially  abore  about 
500  kc/s,  is  very  susceptible  to  absorption,  and,  even  at  night,  sky 
waves  are  often  attenuated  below  useful  levels . 

Because  of  the  unreliability  of  the  sky  wave,  the  frequency  range  is 
probably  most  useful  from  the  low  end  up  to  about  1  me/ s,  where  the  ground 
wave  enables  broadcast  coverage  out  to  several  hundred  miles. 

2.3.4  3-30  nc/s  HF^ 

HF  propagation  is  characterized  by  the  ability  of  high  frequency 
waves  to  penetrate  the  lower  Ionosphere  and  be  reflected  from  the  F  region 
of  the  upper  Ionosphere.  Absorption  is  of  minor  concern  and  transmission 
loss,  even  for  a  long  transmission  distance  (10,000  km  or  more),  may  be 
quite  low.  Useful  signal-to-noise  ratios  are  obtainable  out  to  very 
great  distances  with  very  low  power  and  simple  antennas. 

Because  of  considerable  variability  of  propagation  conditions,  trans¬ 
mission  Is  very  unreliable.  The  consequence  is  that  for  optimum  results 
the  transmitter  must  be  capable  of  changing  to  four  or  five  different 
frequencies,  hoping  that  one  will  work. 

Multipath  is  a  serious  problem.  At  HF  there  are  a  large  number  of 
possible  propagation  paths  with  multipath  time  delays  ranging  from  a  few 
microseconds  to  a  fev  milliseconds.  Multipath  propagation  Imposes  a 
limit  on  keying  speeds  In  digital  systems  since  If  the  multipath  delays 
are  such  that  during  the  sampling  time  there  Is  still  energy  arriving 
from  the  preceding  pulse,  there  is  a  high  probability  of  error.  Pulse 
durations  should  be  somewhat  more  than  twice  the  length  of  the  greatest 
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significant  multipath  delay.  At  H7  it  usually  occurs  in  the  range  of 
from  1  to  5  milliseconds  for  paths  longer  than  about  100  km.  Multipath 
can  be  reduced  by  operating  at  as  high  a  frequency  as  possible .  At  the 
MUF  (maximum  usable  frequency)  only  one  geometric  mode  is  possible. 

In  addition  to  multipath  effects,  dispersion  may  cause  important  dis¬ 
tortion  of  the  transmitted  waveform  in  the  case  of  short  pulses.  Die 
first-order  effect  is  a  lengthening  of  the  pulse.  Under  worst  conditions 
pulses  on  the  order  of  1  microsecond  in  width  we  stretched  to  13  micro¬ 
seconds  . 

Both  fast  and  slow  fading  are  observed  in  connection  with  the  trans¬ 
mission  of  HP  radio  waves.  The  fast  fading  is  usually  due  to  the  inter¬ 
ference  of  two  or  more  unresolved  propagation  modes.  The  slow  fading  is 
attributable  to  variations  in  absorption,  or  changes  in  the  effective 
gains  of  the  transmitting  and  receiving  antennas  resulting  from  changes  in 
the  angles  of  departure  and  arrival  of  the  signals.  In  fast  fading, 
fades  tend  not  to  occur  simultaneously  at  nearby  frequencies.  This  effect 
is  called  selective  fading.  Slow  fading  tends  to  occur  across  a  broad 
band  of  frequencies  and  is  referred  to  as  flat  fading.  The  fading  distri¬ 
butions  of  the  amplitudes  approximate  the  well-known  Rayleigh  distribution 
when  the  wave  arrives  via  several  modes  with  approximately  equal  amplitude 
and  randomly  varying  phases.  Fading  rates  from  1  cps  to  15  cps  are  commonly 
observed. 

Phase  and  frequency  stability  is  very  poor  at  HP.  This  imposes  genuine 
limitations  on  mi m mum  modulation  excursions  for  FSK  and  PSX  systems.  Phase 
perturbations  up  to  l40°  and  frequency  shifts  up  to  50  cps  have  been  observed. 

In  spite  of  the  difficulties  mentioned  above,  there  is  a  great  density 
of  radio  services  in  the  high  frequency  range.  A  substantial  part  of  the 
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world's  frequency  assignments  are  concentrated  In  this  snail  fraction  of 
the  whole  spectrum. 

2.3.5  30-60  nc/s  VHP  Ionospheric  Scatter^ ' 

Irregularities  in  electron  density  In  the  lover  Ionosphere  give  rise 
to  incoherent  scattering  of  radio  wares  In  the  frequency  range  between 
30  and  60  mc/s.  Reliable  transmission  is  obtained  In  the  1000  to  2000 
km  distance  range.  Die  scattered  radio  wares  are  extremely  weak  and 
system  losses  ranging  between  lkO  and  210  db  are  commonly  experienced, 
typically.  Ionospheric  scatter  suffers  around  150  db  more  loss  than  does 
ionospheric  reflection.  To  compensate  for  the  large  losses,  extremely 
large  high  gain  antennas  are  employed. 

Fading  is  observed  at  rates  varying  from  0.2  to  3  cps.  During  most 
of  the  day  the  envelope  fading  Is  approximately  Rayleigh  distributed, 
though  amplitude  distributions  Indicate  peaks  from  meteor  reflections 
during  the  night  hours.  The  fading  characteristics  depend  upon  the  beam- 
width  of  the  antennas  employed.  For  a  60°  horizontal  beamwldth,  the  fading 
rate  has  been  observed  to  be  four  to  five  times  greater  than  for  a  6° 
beamwldth  system,  and  the  depth  of  fading  several  decibels  greater  for 
the  wide  beam  system. 

Multipath  caused  by  reflections  from  meteor  trails  usually  displays 
delays  varying  from  6  microseconds  to  1  millisecond.  The  time  delays 
of  multipath  due  to  auroral  ionization  are  typically  between  0.1  and  k 
milliseconds.  During  times  of  high  solar  activity,  distant  ground  back- 
scatter  can  be  propagated  by  the  Fg  layer  of  the  Ionosphere  resulting  In 

delays  up  to  80  milliseconds,  typically,  the  delays  from  this  source 
are  between  12  and  60  milliseconds.  Because  of  the  Intersymbol  Inter¬ 
ference  caused  by  such  multipath,  an  upper  bound  is  placed  on  the  keying 
rate  of  digital  systems. 
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As  with  HT  signals,  the  frequency  and  phase  stability  is  poor.  At 
50  mc/s  the  expected  Doppler  shift  Is  6  kc/s.  The  large  Doppler  shifts 
are  due  mainly  to  meteor  reflections .  Often  these  signals  are  stronger 
than  the  direct  scatter  signal.  Large  phase  shifts  are  experienced 
During  night  hours  l80°  shifts  occur  approximately  1  per  cent  of  the  time. 
Instantaneous  phase  shifts  of  90°  occur  about  0.2  per  cent  of  the  time. 

2.3.6  30-300  mc/s  Meteor  Scatter  at  VEF^ 

Each  day  billions  of  meteors  enter  the  earth's  atmosphere .  In  burning 

up  they  form  long  columns  of  ionized  particles.  These  columns  diffuse 

rapidly  and  usually  disappear  within  a  few  seconds.  However,  during  their 

brief  existence  the  ionized  columns  will  reflect  radio  signals,  giving 

rise  to  what  is  called  meteor  scatter  or  meteor  propagation. 

Meteor-burst  communication  systems  are  basically  weak- signal  systems 

because  the  signal  loss  associated  with  the  meteor-trail  reflection  is 

relatively  high.  For  example,  a  typical  system  operating  at  50  mc/s  over 

a  1300  km  path  with  a  transmitter  power  of  2  kw  was  commonly  set  to  trans- 
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mit  messages  whenever  the  signal  at  the  receiver  exceeded  2x10  w 
(2  microvolt  open- circuit  voltage  for  a  50  ohm  source).  This  corresponds 
to  a  system  loss  of  170  db.  Of  this  total  about  90  ctb  represents  the 
attenuation  associated  with  the  length  of  the  transmission  path  and  80  db 
the  scattering  loss.  Under  similar  circumstances  ionosphere  scatter 
propagation  would  exhibit  a  system  loss  of  the  order  of  180  db.  Messages 
are  transmitted  only  during  the  brief  intervals  when  meteor  propagation 
is  present. 

At  30  mc/s  Doppler  shifts  as  large  as  5  ke  have  been  observed. 

2.3.7  50-10.000  mc/s  Tropospheric  Scatter^ ^ 

Tropospheric  scatter  results  from  irregularities  in  the  refractive 
index  of  the  atmosphere.  The  signals  are  much  weaker  than  the  VLF  and  LF 
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slgnals  which  employ  tropospheric  duct  propagation.  They  are  very  reliable 
and  are  found  to  be  present  on  a  given  path  with  substantially  the  saae 
average  intensity  day  and  night,  week  in  and  week  out,  regardless  of 
surface  meteorological  conditions.  They  also  exhibit  rapid  fading,  char¬ 
acteristic  of  multipath  transmission. 

The  dominant  feature  of  tropospheric  scatter  signals  is  their  rapid 
fading.  If  a  constant  Intensity  signal  is  emitted  at  the  transmitter,  the 
level  of  the  received  signal  varies  erratically  in  time  with  an  amplitude 
distribution  that  often  closely  approximates  the  Rayleigh  lav.  Occasions 
have  occurred,  however,  when  this  is  not  the  case.  Spectra  of  the  rapid 
signal  fluctuations  closely  approximate  a  Gaussian  distribution. 

Measurements  made  at  frequencies  of  kOO,  3*670,  and  5,050  mc/s 
utilizing  antennas  with  several  degrees  beaawidth  indicate  that  time  delays 
of  about  1  microsecond  at  distances  of  about  200  miles  can  be  expected. 

At  3*700  mc/s  1  microsecond  pulses  were  not  substantially  widened  after 
transmission  over  distances  up  to  285  miles.  It  appears  that  modulation 
bandwidth s  of  several  megacycles  may  be  used. 

2.3.8  Space  Communi cations 

The  frequency  of  the  transmitted  signal  must  be  above  30  mc/s  to 
enable  the  radio  waves  to  penetrate  the  ionosphere.  Between  30  to 
60  mc/s  the  wave  experience  considerable  amplitude  and  angular  scintil¬ 
lations.  Above  100  mc/s  radio  waves  propagate  into  space  fairly  well. 
Severe  fading  has  been  noticed  at  certain  frequencies  and  multipath  has 
been  observed  which  cannot  be  explained  by  current  theories.  Many 
measurements  are  currently  being  made  to  understand  the  radio  ware  propa¬ 
gation  involved  in  space  communication. 
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2.3.9  Concluding  Remarks 

The  results  of  this  section  are  summarized  In  Table  2-1.  The 
tabulated  disturbances  and  propagation  characteristics  must  be  taken  into 
account  in  developing  a  communication  system.  The  remainder  of  this 
report  is  cm  effort  in  that  direction.  In  particular,  the  capacity  of  a 
Rayleigh  fading  channel,  the  design  of  systems  when  the  statistics  of  the 
additive  noise  are  unavailable,  the  process  of  signal  design  and  selection, 
and  the  use  of  error-correcting  codes  are  discussed. 
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TABUS  2-1 


CBABDSL  CHABACTERIZATIOH 


PHEQUENCY 

BAND 

METHOD  0? 
PHOPAGATIOH 

TOPICAL 

DISTANCES 

MULTIPATH 

PHASE 

STABILITY 

RELIABILITY 

TOPICAL 

MODULATION 

BANEWIDTHS 

3-30kc/s 

ducting 

5-20*fa* 

no 

good 

very  good 

20-150  cps 

30- 300kc/ s 

ducting 

l-5Hm 

no 

good 

good 

250  cps 

300  kc/s- 
3  me/  s 

transition 
region  be¬ 
tween  duct¬ 
ing  and 
ionospheric 
reflection 

200  miles 

no 

for  ground 
wave,  yes 
for  sky 
wave 

good  for 
ground 
wave,  poor 
for  sky 
wave 

good  for 
ground 
wave,  poor 
for  sky 
wave 

2-75  kc/s 

3-3Cttc/s 

ionospheric 

reflection 

l-10Mm 

yes 

very  poor 

poor 

3  kc/s 

30-60mc/ a 

ionospheric 

scatter 

1000-  w 
2000  km 

yes 

very  poor 

fair 

5  kc/s 

5°- 

10,  OOOmc/ s 

tropospheric 

scatter 

100- 
1000  tan 

yes 

very  poor 

good 

10  mc/s 

*  Ka  =  me  game  ter 

#*  loft  s 


kilometer 
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CHAP1SR  III 

CAPACITY  OF  THE  RAYLEIGH  FADING  CHANNEL 


3  •  1  Introduction 

As  was  discussed  In  Chapter  II  many  of  the  communication  channels 
commonly  used  experience  Rayleigh  type  fading.  In  this  chapter  the  follow¬ 
ing  assumptions  are  made  concerning  the  parameters  of  the  channel  model 
given  in  Fig.  2.1. 

1)  The  multiplicative  disturbance  A(t)eJ  is  equal  to  A,  where  A 

is  a  random  variable,  Rayleigh  distributed  with  parameter^- 
.  2/2 

p(A)  =  2Ae  'S  A>  0 

=  0  A40  (3-1) 

2)  The  additive  noise  n(t)  is  assumed  to  be  a  stationary  Gaussian 

random  process  with  zero  mean  and  uniform  power  spectrum  over  informa- 

2 

tion  bandwidth  W.  If  E  [n  (t)]  *  N,  then  the  noise  spectrum  is 

Gn(f  >  "  h  -  *o 

3)  Die  signal  s(t)  is  a  sample  function  from  a  stationary  random 

process  and  has  a  finite  power  P.  The  power  spectrum  of  the  signal 

is  G  (f)  and  the  signal  is  bandlimited  to  W  cycles  per  second, 
s 

In  this  chapter  the  channel  capacity  of  the  Rayleigh  fading  channel 
is  derived.  The  results  are  then  used  to  evaluate  0,  the  required  received 
energy  per  information  bit  received  in  the  presence  of  a  given  Gaussian 
noise  spectral  density. 

3.2  Calculation  of  Channel  Capacity 

Capacity  is  defined  as  the  maximum  information,  on  the  average, 
that  an  observer  at  the  output  of  the  channel  can  obtain  about  a  signal 
transmitted  from  the  channel  input.  The  maximization  of  the  information 
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rate  being  carried  out  through  the  variation  of  the  input  signal  char¬ 
acteristics,  l.e.,  the  encoding  process.  Capacity  C,  may  therefore  be  ex¬ 
pressed  as: 

C  =  max  I(S/X) 

(3-2) 

To  solve  for  the  capacity  of  the  Bayleigh  fading  channel  using  the 
above  Eq.  (3-2)  is  a  very  difficult  non-linear  problem. 

(lh) 

Another  expression  for  the  capacity  is  given  by  Fano'  7 

C  =  max  l(s/x) 

|o8(f)ioj  (3-3) 

It  is  easier  to  solve  for  the  capacity  of  the  Rayleigh  fading  channel 
using  the  above  Eq.  (3-3)  since  maxi  ml  zing  over  the  power  spectrum  of  the 
signal  Is  maximizing  under  less  restrictive  conditions. 

Using  Eq.  (3-3)  for  the  conditional  Information  rate  (assuming  A  the 
attenuation  factor  is  known)  results  in 


max  I(S/X,A)  =  max  tpH  A20  (f ) 

{os<f)>o].  {os(t)>o}.  io  1082 1 1  * I “  (3'l° 

Since  the  attenuation  factor  A  is  a  random  variable  it  is  necessary 
to  average  over  all  possible  values  of  the  random  variable.  Thus, 


C  *  max 


*  max  I(S/X)  =  max  « 


I(S/X,A)  p(A)dA 


(3-5) 


f  +W 


»  max  n  f 

'  r 

log  | 

*V)ia  ;‘V 

~5"TfT  e  “  (3‘6) 
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Integrating  with  respect  to  A,  (see  Appendix  I  for  details) 

f +V 


C  »  max 


{o,(rt?o} 


,  0T  r  >Q  (f)  fO(t)  •) 

(ha)1  f  m.\  -=£ - }  exp  H - \ 

I  \  l"20  (f)  j  V20|(t)  J 


df 


(3-7) 


where 


pt  u  * 

KL(t)  « J  dn  -  e* 


I 


k=l 


-- M  *1  4 


k=l 


-Ei(-t)  -  e_t  Y  k(k~1,)' 

ki  * 


t-4  0 


t  >  0 


(3-8) 

(3-8*) 

(3-9) 


Applying  calculus  of  variations  to  maximize  the  above  integral  with 
respect  to  G  (f)  yields 


55^rT 


r  f  °n(f )  ' 

f  ’G„(f)  1  1 

exp  4  -= - 

\  M.  \  -r2 - \  +  X  Off) 

1 - 

1 

f — 

J  l*-2o  (f)  J  8  -1 

(3-10) 


where  X  is  the  Lagrange  multiplier  for  the  power  constraint, 

f  +W 
o 

2  J  Ga(f)df  =  P 


Carrying  out  the  above  differentiation  and  simplifying  reax  Its  in 


2  2  r  1  f  -<*„(*)  1 

■ (,)  ■  °o(t>  -  E  {^}  ■ 0  (3’u) 

*  8 
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Prom  this  result  It  is  observed  that  if  the  addit.we  noise  power 
spectrum  is  uniform  over  a  bandwidth  V,  then  the  power  spectrum  of  the 
signal  s(t)  must  also  be  Independent  of  f .  The  signal  power  spectrum 
therefore  equals, 

-  b 

Therefore,  it  has  “been  proved  that  in  order  to  transmit  at  a  maximum 
rate  through  a  Rayleigh  fading  channel  the  input  signal  s(t)  must  he 
from  a  stationary  process  with  uniform  spectral  density.  It  is  shown  in 
Appendix  II  that  the  input  signal  must  also  he  Gaussian  with  zero  mean. 

The  capacity  of  the  Rayleigh  fading  channel  is  therefore 

C  -  -(m2)-1  »  exp  } 

3.3  Determination  of  the  6  Factor 

One  way  to  compare  communication  systems  is  to  compare  their 
efficiency  in  terms  of  0,  the  received  signal  energy  required  per  informa¬ 
tion  bit  received  in  the  presence  of  a  given  uniform  Gaussian  noise  spec¬ 
tral  density 
Bain 

£  min  *  ml nl mum  received  energy  required  per  information  hit 
received. 

«  noise  spectral  power  density. 

Equivalently,  p  may  he  expressed  as 

a  -  p  a*a 

P  ■  2H  H 
o 

P  m  minimum  received  power  required  per  bit  of  information 
received. 

H  =  rate  of  received  information  (bits  per  second). 


(3-12) 


(3-13) 


(3-14) 
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Letting  H  be  equal  to  the  maximum  received  information  rate,  on  the 
average,  for  the  Rayleigh  fading  channel  one  obtains  for  p 


P 


P 


cr\ 


(!)  -(m2)”1  W  exp  — j  Ei 


-ln2 


(3-15) 


(3-15’) 


The  lower  bound  on  p  occurs  as  the  received  signal- to-noise  power 
ratio  goes  to  zero.  (See  Appendix  IH  and  graph  3 *2  for  proof.)  This 
lower  bound  on  p  is  shown  to  be  given  by 

SWn  -  ^  (3-16) 

Note  that  this  lower  hound  on  p  is  the  same  as  that  obtained  by 
Sanders  for  the  single  path  channel  haying  no  fading.  In  fact  the  lower  bound 
on  p  will  always  equal  ln2  and  is  independent  of  the  type  of  probability 
density  function  for  the  attenuation  factor  A.  To  see  why  this  is  so  one 
notes  that  the  conditional  lower  bound  on  p  (conditional  in  the  sense  that  A 
is  fixed)  is  independent  of  the  value  of  A.  Averaging  over  the  different 
values  of  A  will  therefore  yield  the  same  value  as  for  the  unity  gain  channel . 

Another  way  of  defining  p  in  order  to  bring  out  the  dependence  of  the 
channel  is  to  define  p  as  the  minimum  required  energy  transmitted  per  bit 
of  information  received.  Under  this  definition  the  lower  bound  on  p  can 
be  shown  to  be 


ft  = 

pmin  <^2 


(3-17) 
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vhere  this  lower  hound  on  3  is  obtained  by  letting  the  slgnal-to- noise 

2 

power  ratio  approach  zero.  Since  <r-  il  for  all  passive  channels,  the  lower 

-2 

bound  of  3  is  increased  by  a  factor  <r  over  that  of  the  single  path  with 

gain  equal  to  unity.  In  other  words,  assuming  the  transmission  rate  is  the 

_2 

same,  the  minimum  power  that  must  be  transmitted  is  increased  by  er*  in 
order  to  maintain  the  same  probability  of  error. 

3.^  Discussion  of  Results 

The  capacity  of  the  Bayleigb  fading  channel  is  a  function  of  the 
information  bandwidth  W  and  of  the  ratio  of  received  signal  power  to  the 
received  noise  power, 


-W 

In? 


-W  "{Sr} 


It  should  be  noted  that  if 


°-2P 


»1 


then 


(3-18) 


where  7  =  I.78IO72 

The  capacity  may  therefore  be  approximated  by 

CfcVlogjP  (3-19) 

where  P' s 

Comparing  the  above  equation  with  that  for  the  unity  gain  channel  one 


obtains 


C  =  V  log  (l  +  V  log 


(3-20) 


If  the  slgnal-to-nolee  ratio  <C<  1  then 


.JL  {^1\ 

ln2  \  »  J 


W  PJ_ 

ln2  H 


(3-21) 


However,  the  unity  gain  channel  having  a  algnal-to-noise  ratio 


■«1,  has  the  capacity 


-  &  *{1  +  r} 


A  W  P' 

^ln2  H 


(3-22) 


Hence,  for  small  signal- to-nolse  ratios,  i.e.,  g-^l,  the  capacity 

of  the  Rayleigh  fading  channel  is  Identical  to  that  of  the  unity  gain 


channel . 


From  Jig.  3.1  it  is  observed  that  the  capacity  of  the  Rayleigh  fading 
channel  is  never  less  than  8356  of  the  capacity  of  the  unity  gain  channel. 


It  should  he  noted  that  the  channel  variance 


can  he  determined 


experimentally  hy  transmitting  a  known  carrier  sin  <DQt,  and  measuring  the 
average  power  at  the  receiver. 

V  n 

Jig.  3.2  illustrates  that  0  =  — g - is  a  monotonically  decreasing 

function  of  the  received  noise  to  the  received  signal  power  ratio.  Qual¬ 
itatively  this  implies  that  the  received  signal  energy  required  per  informa¬ 
tion  hit  transmitted  (assuming  that  the  bandwidth  is  constant)  varies  as 


E  .  OH11 
min  o 


k  <  1 


T3NNVH0  NIV9  AlINQ  P  AllOVdVO 
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NOISE  POWER  RECEIVED _ wo 

MINIMUM  SIGNAL  POWER  RECEIVED 

EFFXCXERCI  FACTOR  P,  VS.  THE  RATIO  OF  NOISE  POWER  RECEIVED  TO 
THE  MINIMUM  POWER  RECEIVED 
FIGURE  3.2 
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CHAPTER  IV 

NONLIKELIHOOD  DETECTION  THEORY 
PART  I  GENERAL  THEORY 

4.1  Introduction 

The  problem  of  detection  of  e  signal  in  noise  of  known  statistical 
properties  has  been  investigated  thoroughly  in  the  past.  However,  these 
methods  are  completely  inapplicable  and  inappropriate  whenever  these  noise 
statistics  are  unknown. 

In  this  investigation,  a  detection  criterion  based  on  the  methods  of 
non-parametric  statistics  is  utilized  which  permits  the  design  of  detectors 
on  the  basis  of  much  less  a-priori  information.  Several  detectors  based 
on  this  detection  criterion  are  investigated  and  their  properties  obtained. 
A  comparison  is  made  between  these  new  (non- likelihood)  detectors  and  the 
optimum  (likelihood)  detectors  on  the  basis  of  information  efficiency. 

Also,  a  practical  design  procedure  is  formulated  for  the  design  of  these 
new  (non-likelihood)  detectors. 

4.2  Statement  of  the  Problem 

Given  a  signal  immersed  in  noise  of  unknown  distribution  function,  a 
detector  is  to  be  designed  based  on  a  detection  criterion  that  does  not 
require  knowledge  of  the  noise  and  of  the  mixture  of  signal  and  noise 
probability  densities. 

4.3  Inadequacy  of  Present  Methods 

Detectors  which  determine  the  presence  or  absence  of  a  signal  in 
noise  have  been  investigated  extensively  in  the  past.  These  investigations, 
however,  have  been  based  on  the  assumption  that  a  great  amount  of  a-priori 


36- 


information  Is  available  concerning  the  probability  densities  of  the  noise 
and  of  the  mixture  of  signal  and  noise.  These  detectors  are  based  on  the 
likelihood  ratio. 

However,  these  likelihood  (optimum)  detectors  are  completely  Inadequate 
and  inappropriate  whenever  these  noise  probability  densities  are  not  known. 
This  is  so,  since  these  detectors  are  optimum  only  for  a  particular  pair  of 
noise  and  mixture  of  signal  and  noise  probability  distributions  for  which 
they  have  been  designed.  In  general,  the  probability  of  error  (reliability 
of  transmission  of  information)  of  the  likelihood  detectors  depends  on  the 
functional  form  of  these  distributions.  Therefore,  if  a  likelihood  detector 
which  is  optimum  for  a  particular  pair  of  probability  distributions  is  used 
in  another  situation  in  which  the  distributions  are  different  from  the 
pair  of  distributions  for  which  the  detector  is  optimum,  then  it  is 
possible  and  quite  probable  that  the  probability  of  error  of  the  detector 
(unreliability  of  transmission)  may  increase  to  such  an  extent  as  to  make 
the  detector  completely  inapplicable.  Moreover,  due  to  this  lack  of  a-prlorl 
information  of  the  probability  distributions,  it  is  not  possible  to  predict 
and  evaluate  theoretically  the  performance  of  these  likelihood  detectors. 
Hence,  the  likelihood  detectors  are  inappropriate  whenever  there  is  in¬ 
complete  information  concerning  the  functional  form  of  the  underlying 
distributions . 

U.4  The  Hon- likelihood  (Hon-parametric)  Detection  Criterion 

In  this  investigation  a  detection  criterion  is  used  which  leads  to 
the  design  of  detectors  on  the  basis  of  much  less  a-priori  information. 

These  detectors,  hereon  called  non- likelihood  detectors,  are  based  on 
statistical  tests  known  in  the  statistical  literature  as  non-parametric 
statistical  tests. 


{ 
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|  COMNDHICAZZ05  SYSTEM 
H(t)  KtODRB  4.1  IT'  (t) 

Where  S(t)  Is  the  signal ,  H(t)  end  H'(t)  are  sample  functions  of  the  noise 


random  process 


M 


It  Is  assumed  that: 


vhen  the  signal  is  absent,  it 


is  also  stationary; 


1)  {x(t)j  Is  a  stationary  continuous  parameter  stochastic  process 

Since  M  Is  identical  to  vhen  the  signal  is  absent,  it 

can  be  concluded  that  {■00}  is  also  stationary; 

2)  It  Is  possible  to  obtain  n  Independent  samples  T  ,  ...  Yq 

from  the  sample  function  Y(t)  of  -jx(t)i; 

3)  There  is  available  a  sample  function  I'(t)  from  the  stationary 
continuous  stochastic  process  {*(»)}  of  the  noise; 

4)  It  is  possible  to  obtain  m  Independent  samples  w  w 

. . .  T  from  the  sample  function  S'(t). 
n+m 

On  the  basis  of  the  samples  Y^,  ...,  Yq  and  Yq+^,  ...,  YQ+m  a 
decision  procedure  for  detecting  signals  in  noise  is  formulated  by  testing 
H'q:  cumulative  distribution  function  (cdf.)  of  Y^  is  Pq(Y)  i=l,  n+m 

signal  is  absent,  against 

H',:  cdf.  of  Y.  is  P  (Y)  i-1.  ....  n  and  the  cdf.  of  Y  .  is  P  (Y)  for 
j.  1  z  n+j  o 

J»l,  ...,  a,  signal  is  present. 


-38- 


vhere  Pq(y)  Is  the  distribution  function  of  any  of  the  data  elements 

(since  ■jr(t)j-  is  stationary )  vhen  signal  is  absent^  and  ( Y )  Is  the 

cumulative  distribution  function  for  any  data  element  when  the  signal  is 

present.  Note  that  P  (Y)  depends  both  on  Y  and  on  the  signal- to-noise 

z 


ratio  z. 


The  above  decision  procedure  simply  states  that:  if  the  signal  is 
absent  then  the  cdf.  of  the  Y^,  is  Pq(y)  and  must  be  the  same  as  the  cdf. 
of  the  Yn+j's  since  both  sets  of  observations  were  obtained  from  sample 


functions  of  the  same  continuous  stochastic  process 


If  the 


signal  is  present,  then  the  cdf.  of  the  Y. 's  is  P  (Y)  *nlch  is  not  the  same 

1  z 

as  the  cdf.  P  (Y)  of  the  Y  's. 

o'  n+j 

In  a  practical  case,  the  sample  function  N’(t)  of  the  noise  process 
j*(t)j-  must  be  obtained  from  the  noise  entering  the  receiver  during  a  time 
that  no  information  is  transmitted  (signal  absent).  If  the  noise  process  is 
stationary  then  H*(t)  can  be  obtained  once  and  for  all  before  the  trans¬ 
mission  of  information  begins.  Prom  N'(t),  the  m  samples  will  then  be  ob¬ 
tained  and  stored  in  the  receivei,  to  be  compared  later  with  the  n  samples 
obtained  from  Y(t).  If  though  the  noise  random  process  i3  not  stationary, 
then,  before  the  transmission  of  information  commences,  one  obtains  the  m 
samples  from  the  noise  entering  the  receiver  and  uses  them  only  for  as  long 
as  the  noise  random  process  remains  fairly  stationary.  Whenever  the  noise 
process  varies  considerably  then  the  transmission  of  information  must  be 
interrupted  for  a  sufficient  time  to  enable  one  to  obtain  a  new  set  of  m 


samples  to  be  used  subsequently.  If  the  noise  process  variations  are  of 
a  permanent  nature,  a  periodic  sampling  of  the  noise  is  necessitated. 
During  sampling,  the  transmission  of  information  must  cease  to  pexmit  the 
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acquisition  of  the  m  samples  from  the  noise  entering  the  receiver. 

A  practical  example  of  a  stationary  type  of  noise  is  the  case  of  con¬ 
tinuous  jamming  with  stationary  noise.  In  this  case,  the  m  samples  need 
be  obtained  only  once,  prior  to  commencing  the  transmission  of  information. 

A  practical  case  of  non- stationary  noise  is  the  ca6e  of  on-off  Jamming  where 
the  jamming  is  on  or  off  for  periods  comparable  to  the  sampling  interval 
required  to  obtain  the  n  samples.  In  this  case  two  sets  of  m  samples  must 
be  available,  one  to  be  obtained  and  used  when  the  jamming  noise  is  off  and 
the  other  set  to  be  obtained  and  used  when  the  jamming  noise  is  on. 

The  theory  of  non- likelihood  detection  would  be  useful  if  it  satisfies 
the  following  requirements:  l)  it  suggests  the  'structure  of  the  detection 
system;  2)  it  specifies  procedures  for  evaluating  the  performance  of  such 
systems  (information  rate,  probability  of  error);  and  3)  it  specifies  tech¬ 
niques  of  system  comparison.  It  will  be  seen  subsequently  that  the  non¬ 
likelihood  theory  of  detection  does  satisfy  sill  of  the  above  requirements. 
4.5  General  Properties  of  Ron-parametric  Detectors 

In  this  investigation  a  restriction  of  the  level  of  generality 
will  be  made  by  considering  the  detection  of  weak  signals  in  noise. 

This  means  that  the  peak- signal- to- rms  noise  ratio  and  thus  z  is  assumed 
to  be  very  close  to  zero.  This  is  appropriate  since  the  weak  signal  case 
is  the  most  troublesome  and  least  amenable  to  solution  and  the  case  one 
usually  desires  to  solve  in  practice.  This  is  also  expedient  since  it 
sinqplifies  the  analytical  expressions  found. 

Many  of  the  non-parametric  detection  test  statistics  satisfy  the 


following  properties: 


1)  The  non-parametric  detection  statistic  U  _  (the  subscript  am  is 

mn 

to  show  dependence  on  the  samples  m  and  n)  is  asymptotically  Gaussian 

under  H'  (no  signal).  The  mean  and  standard  deviation  of  this 
o 

limiting  distribution  are  denoted  by  E  fU  1  and  [U  l ,  respectively, 

o  mn  o  mn 

2)  is  asymptoti caJJLy  normal  under  (signal  present).  The 

mean  and  standard  deviation  of  this  limiting  distribution  are  denoted  by 

E  fU  ]  and  cr  [U  ],  respectively; 
z  *  mn  z  mn 


3) 
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z  mn 


E  [U  ] 
ol  mn 


+  z 
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z  mn 
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Z-0 
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where  K  is  a  constant  Independent  of  m,  n,  z  and  defined  by  Eq.  (4-3);  K 

depends  only  on  P  (Y)  and  P  (Y). 

o  z 

6) 


(4-3) 


z  mn 


dz 


z-o 
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limit  <rj 2[U  ]  -  0 
o  mn 

n~*» 

(16) 

On  the  basis  of  the  above  properties  it  can  be  shown  that  the  non- 
parametric  detection  tests  possess  the  property  of  consistency.  A  detection 
test  of  Hq  against  of  probability  of  false  alarm  <<  is  said  to  be  consistent  if 


0 


limit  B  = 
mn 

m  — 
n  — *» 


(k. 


vhere  p  is  the  probability  of  false  dismissal.  Note  the  dependence  of  p 
on  m  and  n  shown  by  the  subscript  mn.  The  property  of  consistency  is  an 
extremely  important  one  since  it  states  that  for  fixed  z  and  a  the 
decisions  on  the  presence  or  absence  of  the  signal  become  more  reliable  as 
more  observations  are  obtained. 

According  to  property  (l)  above  the  following  general  character  of 

non -parametric  detection  statistic  U  ^  obtains  when  m  and  n  are  moderately 

mn 

large: 


PROBABILITY  DENSITY  OF  U  FOR  LARGE  VALUES  OF  m  AND  n, 

an 


UNDER  SIGNAL  AND  NO  SIGNAL  CONDITIONS 
FIGURE  4.2 
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So  then, 
°^mn 


2*  tf“[U  . 
o  on 


•’]  ^  /  *  ~*  [  -1/2  <*- W  %l] 


(<t-6) 


or 


O /  =  1/2  (1  -  erf  X»0 

mn 


where 


and 


x 

erf  x  =  2(#)_1/2  /  exp  (-u2)  du 

J  o 

]/ 


(4-7) 


U*"  W 


Also, 


ft 


mn 


2jc 


1/2  X  «*p[-l/3<!'-yo„])!7  ]  dy  <4- 
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When  z  is  sufficiently  small  then  using  properties  (3)  and  (4)  we  obtain: 
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and  from  (4-8)  there  follows 
Xey  =  erf"1  (1  -  20^) 

Adding  Eq.  (4-6)  to  Eq.  (4-10)  gives 


(4-11) 
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Using  property  (5)  the  following  relation  obtains 

jjf  -  zlfTt'X  (1-24i)  +  grf'1 

The  above  relation  states  that 

a)  for  decreasing  signal-to-noise  ratio  z,  the  number  of  samples 
n  must  increase  in  order  to  maintain  a  constant  probability  of  error 
(constant  <X,  and  p).  If  proportional  sampling  is  used,  then  an  in¬ 
crease  in  the  number  of  samples  means  an  increase  in  the  sampling 
interval  and  consequently  a  decrease  in  information  rate. 

b)  for  increasing  signal-to-noise  ratio  and  constant  number  of 
samples  (constant  information  rate)  the  probability  of  error 
(or  ^  ,  p)  decreases 

c)  for  increasing  sign&l-to- noise  ratio  and  constant  reliability 
(constant  probability  of  error)  the  number  of  samples  n  required 
decreases  and  thus  the  information  rate  increases. 

The  above  relation  is  an  extremely  important  one.  It  permits  the  de¬ 
sign  of  a  system  that  will  guarantee  a  certain  desired  <<  and  p  for  the  mini- 
mum  possible  z .  That  is,  if  an  <a  =  10  ,  p  =  10  is  desired  and  a  signal 

is  to  be  detected  so  weak  that  z  =  10  ,  the  only  thing  we  need  to  know 

is  K  in  order  to  determine  the  req\d.red  samples  — It  Is  also  possible 

mrn 

thereby  to  obtain  the  performance  characteristics  of  the  detector  In  question. 

To  facilitate  comparison  between  the  non- livelihood  detectors  and 
the  likelihood  detectors  the  following  limiting  properties  of  the  like¬ 
lihood  detectors  are  stated. 

The  likelihood  statistic  U  satisfies  the  following  relations: 

n 

(l* )  UQ  is  asymptotically  normal  under  Hq  (no  signal).  The  mean 
and  standard  deviation  of  the  limiting  distribution  are  denoted  by 
Eq[U]  and  flr  [U  ]  respectively; 


(2 ' )  Un  Is  asynptotically  normal  under  H^.  She  mean  and  standard 
deviation  of  this  limiting  distribution  are  given  by  K„[U  ]  and 

Z  u 

<T  [U  ]  respectively; 

Z  II 
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tv 

limit  — 9  1  — 

0  «o  tV 
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w  -  w 

dE_[U]| 

+  z-o  +  o(z  } 

(4-15) 

(5*) 

r«W 

z — >o  L 

(4-16) 

where  K  is  a  constant  independent  of  n  and  z  and  dependent  only- 


on  P  (Y)  and  P  (Y). 
o  z 


(4-17) 

dz 

(7’)  limit 
n— v° 

4  [°,i  -  ° 

(4-i8) 

On  the  basis  of  the  above  properties,  it  can  be  shown  that  the 
likelihood  tests  are  consistent.  Also  similarly  to  the  proof  for 
the  case  of  non- likelihood  detectors  is  the  proof  for  the  following 
property  of  the  likelihood  detectors: 


Kz2  n  =  2 [erf-1  (1-2  c^)  +  erf’1  (l-2pn)]2  (4-19) 

It  was  stated  previously-  that  a  detection  theory  to  be  complete 
must  also  incorporate  a  means  of  comparison  between  different  detectors. 

Toward  this  end  the  asymptotic  relative  efficiency  [A.R.E.]  of  a  non¬ 
likelihood  detector  U*  __  with  respect  to  the  non- likelihood  detector 


U  Is  defined  as 
mn 
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m*fn* 


where  l)  the  false  dismissal  and  the  false  alarm  probabilities  of  U 


nm 


(4-20) 


and  P»  are  equal 


mn 


=  o(* 


xn*n* 


mn 


p* 


m*n* 


P 


2)  the  U _  and  U*  -  ■  detectors  are  for  the  detection  of  the  same 

signal  In  the  same  noise  and  for  the  same  small  signal- to-nolse 
ratio  (weak  signals) 

For  m*»n*  and  m??n,  E^^  =  limit  jjjp  .  Thus,  the  A.R.E.  of  one  non- 

Z  — *0 

likelihood  detector  with  respect  to  another  is  an  indication  of  how  many- 
more  observations  one  non- likelihood  detector  requires  than  the  other  to 
detect  a  given  weak  signal  with  a  prescribed  accuracy  ot,  0  when 
m*»n*  and  m?>n. 

From  the  given  properties  (l)  -  (7)  of  the  non- likelihood  statistics, 

e(U*  ) 

it  can  be  proven  that  E^^  *  * 

'  ion  * 


vhere 
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dz 
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(4-21) 


It  is  also  useful  to  define  the  A.R.E.  of  a  non- likelihood  detector 


U*^,  with  respect  to  a  likelihood  detector  Ufl  as  follows: 


I“W,  °n 


limit 
z — vo 
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n* 


(4-22) 


in  the  direction  of  the  same  weaJc  signal  (same  z)  and  with  the  sameo(, 
and  3.  So  since 


K*z2  p-jj  =  2  [erf-1  (l-2o<)  +  erf'1  (l-2p)]2 

for  the  non- likelihood  detector 
and 

Kz2  n  =  2 [erf'1  (1-2  «*)  +  erf'1  (l-2p)]2 


(4-23) 


(4-24) 


for  the  likelihood  detector 


it  follows  that 

-  _  _ 1 

u*,u  ~  K  ,  ^  n* 

1  +  5* 


(4-25) 


Since  K*  and  K  are  independent  of  z,  m,  n,  ra*  and  n*,  is  indepen- 

n* 

dent  of  z  and  depends  on  the  sample  sizes  only  through  the  ratio  jjj  ;  that 
is  the  ratio  of  sample  sizes  used  "by  the  non- likelihood  detector.  Thus,  the 
A.R.E.  of  P*  with  respect  to  UQ  is  as  high  as  possible  if  m*  >>n*. 

That  is,  the  number  of  observations  from  the  auxiliary  noise  source  N'(t) 
should  be  much  larger  than  the  number  of  observations  from  Z(t). 

Thus,  one  design  criterion  for  the  non- likelihood  detector  is, 
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It  should  he  stressed  that  K*  and  K  are  dependent  on  Pq(y)  and 

P  (Y).  The  comparison  of  a  non- likelihood  detector  to  a  likelihood 
z 

detector  Is  valid  only  for  a  particular  pair  of  cdf ’s.  To  gain  some 
insight  on  the  physical  significance  of  the  asymptotic  relative  efficiency 
consider  the  following:  one  of  the  most  Important  considerations  In  a 
detection  problem  is  the  length  of  time  required  to  detect  the  signal  with 
a  certain  accuracy  o<  ,  0.  In  most  cases  the  m*  observations  obtained 
from  H’(t)  by  the  nan-parametric  detector  can  be  obtained  before  the  n* 
observations  are  obtained  from  Z(t),  and  can  be  stored  In  the  non- likeli¬ 
hood  detector.  So,  the  only  time  consumed  is  that  used  In  obtaining  the  n* 
samples  from  Z(t).  Similarly,  the  only  time  spent  by  the  likelihood  de¬ 
tector  is  that  used  in  obtaining  the  n  samples  from  Z(t).  If  periodic 
sampling  is  employed,  then  n*  and  n  are  proportional,  respectively,  to  the 
time  required  by  the  non-likelihood  and  likelihood  detectors  to  detect  the 
same  weak  signal  with  the  same  accuracy  ,  0.  Thus,  the  justification  for 
the  criterion  of  A.R.E.  (asymptotic  relative  efficiency)  is  that  for 
periodic  sampling  it  gives  an  indication  of  how  much  better  the  information 
rate  of  the  non- likelihood  detector  is  than  that  of  the  likelihood  detector 
in  the  detection  of  the  same  weak  signal  for  a  prescribed  probability  of 
error. 

4.6  Summary  of  Important  Properties  of  Eon-llkellhood  Detectors 

The  following  are  the  most  significant  properties  of  the  non- likelihood 
detectors  for  their  design. 

l)  Asymptotic  normality  under  signal  and  under  no- signal  conditions 
?.)  Die  performance  relation  for  weak  signals 

Kz2  n  =  2[erf_1  (1-2 )  +  erf-1  (1-20  )]2 

'  am 9  BBl 


(4-26) 


3)  Ho  knowledge  of  the  cdf's  P  (Y)  and  P  (y)  Is  required  other  than 

o  z 

seme  functional  of  P  (Y)  and  P  (Y)  e.g.  max.  P  (Y )  -  P  (Y)  for  the 
o  z  o  z 

determination  of  K.  Note  that  K  depends  only  on  P  (Y)  and  P  (Y). 

o  z 

4)  The  efficiency  of  the  non- likelihood  detector  is  highest  when 

m»  n. 

4.7  A  Practical  Design  Procedure 

In  a  practical  situation  a  certain  reliability  (<*,  0)  is  specified 
and  the  weakest  signal  (or  smallest  z)  to  be  detected  is  known.  A  case 
of  the  latter  is  the  case  of  radar  detection  where  z  is  a  function  of 
among  others  the  range  of  the  radar  system.  So  the  smallest  z  for  the 
particular  range  can  be  easily  determined  theoretically  or  experimentally 
if  the  range  is  known.  The  first  step  in  the  design  of  a  suitable  detection 
system  is  to  choose  a  non- likelihood  detector  from  the  many  available  e.g. 
a  Mann-Whltney  detector,  or  a  Kolmogorov- 3mi rnov  detector  based  on  the 
Mann-Vhltney  and  Kolmogorov- Smirnov  statistical  tests,  respectively. 

The  non- likelihood  statistical  detection  tests  are  asymptotically 
normal  under  signal  and  no-signal  conditions  and  there  the  situation  is 
as  depicted  in  Tig.  4.2.  How,  the  threshold  that  will  ensure  the 
required  probability  of  false  alarm  is  given  by 


00 


where  since  p^U^)  is  Qaussian  the  only  constants  required  are  the  mean 
and  standard  deviation  of  the  random  variable  U  under  no- signal  candi- 

wtn 

tions.  These  constants  can  be  obtained  experimentally,  so  that 


(4-27) 
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writing 

,  °*  -  W 

**  ■  rlCT 


and 
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erf  1*2  (jc)'1/2  ^  ea®  (-u2)  da 


It  follows  that 

-C  »  1/2  (1  -  erf  la)  (4-29) 

or 

XoC  -  erf"1  (1-2  ) 

SO 

°*  ■  t««_1  U-2*)l  *  *o  IV1  (l*-30) 

therefore,  if  and  ^[U^]  are  found  esqperinentally  and  the  required 

<<  is  specified  then  the  threshold  D<x  can  he  obtained.  If  exceeds 
Uot.  the  decision  that  a  signal  is  present  is  aade.  If  U  is  less  than 
Uo(  the  decision  that  no  signal  is  present  is  aade. 

Hawing  insured  the  required  value  of  e(  through  the  proper  selection 
of  Uot ,  a  value  of  fJ  saaller  or  equal  to  the  specified  value  is  to  be 
obtained.  To  do  so,  we  osploy  the  zelation 


Kz2  ■  2 [erf-1  (1-2  «(  )  +  erf-1  (l-2p)]2  (4-31) 

It  is  taken  that  m  » n  to  insure  the  highest  information  efficiency,  so 
that 


Kz2  n  -  2 [erf-1  (1-2*)  +  erf"1  (l-2p)]2 


(4-32) 
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Ihe  right  side  of  the  equation  is  a  known  number  and  so  is  z,  being  the 
smallest  signal-to- noise  ratio  for  which  a  detection  is  to  be  affected, 
jfoe  constant  K  can  be  obtained  theoretically  or  most  often  by  experiment . 
Therefore,  since  everything  else  is  known  the  number  of  observations  n 
that  will  give  us  the  specified  <<  and  a  maxi  mum  p  equal  to  the  specified 
false  dismissal  probability,  is  obtained.  Thus,  the  whole  design  problem 
has  been  completed.  Tor  the  case  of  periodic  sampling  the  number  of 
observations  n  will  give  also  the  time  required  for  detection  and  conse¬ 
quently  the  information  rate. 

Fro.  the  above  design  procedure  it  is  seen  that  the  following 
quantities  need  to  be  known: 

1)  the  constant  K  that  depends  on  some  functional  of  Pq(y)  and  Pz(Y) 

2)  the  mean  B  and  of  the  statistic  under  no-signal 

conditions . 

Experimental  work  must  be  done  to  obtain  these  quantities.  A  detailed 
description  of  this  experimental  work  is  given  in  another  section  of 
this  report. 

4.8  General  Conclusions 

It  was  stated  previously  that,  for  a  detection  theory  in  general  to 
be  complete, 

1)  it  must  suggest  the  structure  of  the  detection  system 

2)  it  must  specify  procedures  for  evaluating  the  perfoimance  of 
such  systems  (information  rate,  probability  of  error) 

3)  it  must  specify  techniques  of  system  comparison 

Si  Part  II  of  this  report  where  particular  non- likelihood  detection 
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criteria  (e.g.,  Msnn-lhitney,  Iolmcgorov-tairnov,  etc.)  are  investigated, 

It  Is  shown  that  the  criterion  itself  suggests  the  structure  of  the  de¬ 
tection  system.  These  detection  systems  can  he  easily  implemented  using 
digital  techniques. 

An  evaluation  of  the  performance  of  the  non- likelihood  detectors 
can  he  made  through  the  relation. 

Iz2  n  -  2 [erf-1  (1-2  * )  +  erf"1  (l-2p)]2 
Through  It  a  lower  hound  for  the  Information  rate  may  he  obtained  when 
at,  ,  0,  and  the  smallest  z  are  specified.  Also,  when  the  Information 
rate  (or  n)  and  the  smallest  z  are  specified,  an  upper  hound  for  the  pro¬ 
bability  of  error  can  he  had. 

Uaing  the  concept  of  asymptotic  relative  efficiency  a  comparison 
can  be  made  between  the  different  systems.  The  A.B.E.  for  periodic  sai¬ 
ling  becomes  a  comparison  between  different  systems  on  the  basis  of  In¬ 
formation  rate  for  the  some  probability  of  error  end  same  slgnal-to-nolae 
ratio. 

Thus,  it  is  seen  that  the  theory  of  non-likelihood  (nan-parametric ) 
detection  la  complete. 

Moreover,  the  non- likelihood  detectors  are  the  only  ones  appropriate 
for  the  case  where  little  Is  known  about  the  probability  distributions.  In 
fact,  the  only  quantities  that  need  to  be  known  are  the  mean  and  standard 

deviation  of  U _ under  no- signal  conditions  and  the  constant  K.  These 

nn 

quantities  are  easier  to  obtain  than  the  probability  distributions. 

Another  extremely  important  advantage  of  the  non- likelihood  detectors 
is  that,  no  assumption  is  required  on  the  nature  of  the  channel,  e.g., 
whether  the  noise  is  additive,  multiplicative  or  both.  The  only  thing  It 
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requires  Is  that  Pq(t)  and  PZ(T)  have  different  aeans. 

4.9  Experimental  Work  Heeded 

Experimental  work  is  needed  to  obtain  the  means  and  standard  devia¬ 
tions  of  different  non- likelihood  detectors  under  different  noise  densi¬ 
ties.  Also,  the  efffect  of  the  dependence  of  the  observations  on  the 
performance  of  the  system  should  be  ascertained.  An  experimental  set-up 
can  be  easily  made  to  do  that.  Another  quantity  that  has  to  be  experi¬ 
mentally  determined  is  the  constant  K  that  depends  on  PQ(X)  and  P?  (7 ) 
and  the  particular  detector  used.  A  procedure  to  obtain  K  is  the 
following:  using  the  same  noise  and  signal  and  noise  probability  densities 
a  plot  of  n  vs  2[erf"  (l-2®<)  +  erf  (1-20)]  for  the  same  z  is  obtained. 
From  the  Inverse  of  the  slope  of  the  line  that  is  obtained,  K  for  the 
detector  under  consideration  and  for  the  particular  noise  and  signal 
used  can  be  deduced.  This  experiment  is  repeated  for  different  noises 
and  signals,  if  the  experiment  is  done  in  the  laboratory,  or  it  can  be 
done  only  once  in  the  field  for  the  actual  noise  and  signal  that  pertain 
to  the  particular  c ornmuni cation  problem  of  Interest  (ionospheric  trans¬ 
mission,  etc.)* 
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past  II  SPECIFIC  BPHLIKKLTHOOD  DETECTORS;  EXAMPLES 


4.10  Optimum  ( Subopt laum)  Livelihood  Detector 

To  facilitate  comparison  of  the  non- likelihood  detectors  with  the 
likelihood  detector  certain  results  will  be  obtained  pertaining  to  the 
likelihood  detector.  In  particular  the  asymptotic  relative  efficiency 
of  the  likelihood  detector  will  be  obtained  for  various  noise  and  signal 
and  noise  distributions. 

4.11  The  Optimum  Detector 

It  is  well-known  that  the  optimum  detector  bases  Its  decisions  on 
a  statistical  test  known  as  the  likelihood  ratio 


,  .  “i  vz(y<) 


The  important  assumption  that  P  (y)  can  be  expressed  as  a  series  of 

z 

ascending  powers  of  the  signal- to-noise  ratio  z  Is  now  made.  In  so 
doing  it  is  assumed  that  P_(y)  has  derivatives  of  all  orders  with  respect 
to  z  at  z  ■  0.  It  is  also  assumed  that  the  series  converges  for  all  y 
and  for  all  z.  So, 

.  .  „  O  . 

0  4.  z  4  00 
-®  ^  y  4  00 

where 


rz(y)  *  PQ(y)  +  z*(y)  +  o(zd) 


d z 


z  =  o 


Eq.  (4-34)  is  differentiated  with  respect  to  y  to  obtain 
pz(y)  -  PD(y)  +  z^'(y)  +  o(z2) 
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If  P  (y)  Is  absolutely  continuous,  then  exchanging  differentiation  in 
z 

(4-37) 

ap.(y)  I 

vW— 1-| 

Substituting  Bq.  (4-36)  in  Bq.  (4-33)  we  obtain 
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When  a  strictly  increasing  relationship  exists  between  two  test  statistics, 

then  these  statistics  are  equivalent  for  a  given  detection  problem.  If 

2 

z  is  sufficiently  snail  the  tern  0(z)  in  Bq.  (4-39)  nay  be  neglected. 

Thus,  the  following  equivalent  statistic  is  obtained. 


or 
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(4-41) 
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The  test  L  is  known  as  the  locally  optima  detection  criterion  since  it 

is  qptiaua  only  for  values  of  z  close  to  zero.  It  should  be  stressed 
* 

that  the  L  -  test  is  optima  only  for  the  particular  pair  of  cdf’s 
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£ 

P  (y)  and  P  (y)  for  which  It  has  haen  dssigned.  The  statistic  L  is 

O  Z  II 

different  for  different  detection  problems  with  different  cdf’s  PQ(y) 
and  PB(y). 

# 

It  is  shown  in  reference  (l6)  that  L  satisfies  properties  (l * )  - 
(7')  if  the  integral 


J  t>’2  (y)  /  pQ(y)  dz 


<  » 


is  bounded.  It  is  also  shown  that 
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has  been  named  by  Pitman  as  the  efficacy  of  the  test  statistic  P  . 

* 

The  efficacy  of  L  is 

e(L*n)  =  n  J  ^  b*2  (y)  /  pQ(y)J  dz 
4.12  Detection  Problems 

The  first  problem,  that  of  detecting  a  constant  signal  in  additive 
normal  noise,  is  known  as  the  DC  detection  problem.  The  random  process 
9(t)  is  assumed  to  be  a  normal  process.  Thus,  when  S(t)  is  absent  the 


(4-42) 


(4-43) 


(4-44) 


(4-45) 
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pdf  for  any  data  element  y^  1-1,  . . n  la  giTen  by 
0o(y)  -  (2jcdJ)  exp  |^(-l/2  ] 


(4-46) 


where  a  and  <S  £  are  the  aean  and  variance  of  the  noire.  The  signal -to- noise 


ratio  z  for  this  problem  is  defined  as 
A 

* 


(4-47) 


where  A  is  the  magnitude  of  the  constant  signal. 
Thus, 


*,(y)  «  0o(y-*)  (4-48) 

So  for  the  above  problem  p  (y)  and  p  (y)  are  related  as  follows 

o  z 

p0(y-z)  *  pz(y)  (4-49) 

Whenever  H  specifies  a  pdf  p  (y)  and  E,  specifies  a  pdf  p  (y)  such  that 
o  ox  z 

Eq.  (h— h-9)  is  valid,  then  the  detection  problem  is  known  as  a  test  for 
translation  alternatives. 

* 

The  optimum  test  statistic  L  for  the  DC  detection  problem  hereon 
designated  as  tQ  is  shown  to  be 


><jv 


*1  »o  <yi> 

~W 


n 


1-1 


(4-50) 


where 

v  «  JtS 

y  I 

It  is  seen  that  tQ  is  Independent  of  z  and  that  the  optimum  detector  is  a 


(4-51) 
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summing  device.  The  efficacy  of  tQ  Is  obtained  as 


e(tn)  -  n  J y2  0Q  (y)  dy  -  n  (4-52) 

Sms, 

k  -  1 

The  second  problem  to  be  examined  Is  the  noncoherent  detection  of  a 
sine -wave  In  additive  norst-rvl  narrow-band  noise,  hereon  known  as  the  nonco¬ 
herent  detection  problem.  The  process  (N(t)}  is  a  narrow-band  normal  random 
process  with  mean  zero  and  N(t)  is  a  sample  function  of  this  process. 

Y(t)  is  the  same  as  H(t)  when  signal  Is  absent  and  Is  the  sum  of  N(t)  and 
a  sine-wave  when  signal  is  present.  The  Y^  is  a  random  variable  which  Is 
obtained  from  the  envelope  of  a  narrow-band  normal  noise  when  signal  Is 
absent  and  from  the  envelope  of  a  narrow-band  normal  noise  plus  sine- 
wave  when  signal  is  present.  The  pdf  of  Y^  when  signal  Is  present  is 


Vy) 


_z_ 


exp 


2  6 


10  (Ay  !<s H) 


(4-53) 


=  0  y  <■  0 

where  IQ  is  the  modified  Bessel  function  of  first  kind,  zero  order,  A  Is 

2 

the  peak  of  thr>  sine-wave,  and  ^  is  the  mean  square  value  of  the  noise. 
The  pdf  when  signal  Is  absent  is  gotten  by  setting  A  *  0;  thus. 


y  >  0 


(4-5*) 


y  £.  0 


y 


(4-55) 


-58- 


and 


thus, 

H,c(y)  -  2y  exp  (-y2)  y  *  0 
»  0  y  c  0 

fz(y)  -  2y  exp  (-y2-z)  I^yz1^),  y  »  0 

«  0  y<L  0 


(*-56) 


(4-57) 

(4-58) 


The  optimum  test  statistic  for  the  noncoherent  detection  problem  denoted 


by  t^  Is 


*n  (yl;  yn^  ”n  (yl  "  ^ 


(4-49) 


1-1 


The  t^  test  Is  a  locally  most  powerful  test  for  the  noncoherent  detection 
problem  since  It  charges  for  values  of  z  other  than  those  close  to  zero. 
The  detector  Is  a  simple  square-law  device.  The  efficacy  Is  given  by 


e(t^)  =  n  J  (y2  -l)2  <f'0(y)  dy  -  n  (4-60) 

thus,  k  -  l 

It  can  be  shown  that  In  general  for  translation  alternatives 

e(tn)  -  n  (4-6l) 

and 

k  -  1  (4-62) 

It  should  be  stressed  that  while  the  likelihood  detector  L  Is 

XI 

* 

optimum  for  all  values  of  z,  the  modified  likelihood  detector  L  may 
or  may  not  be  optimum  depending  on  the  particular  pair  of  cdf's  PQ(y) 
and  pz(y)« 
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4,13  the  Mann- Whitney  Detector 

The  Mann-Vhitney  test  was  introduced  "by  Mann  and  Whitney and  la 
based  on  the  statistic 

n  n 

I  I  c(yi'W 

1-1  J-l 

where 

C(x)  -  1,  if  x  >  0 

-  0,  if  x  c  0 

Die  case  x  ■  0  is  not  considered  since  if  P(y)  and  P  (y)  are  continuous, 

z 

the  probability  is  zero  that  any  one  of  the  y^'s  is  equal  to  any  one  of 
the  yn+jJ's. 

She  statistic  V _  essentially  counts  the  number  of  times  the  mag- 

XBu 

nitude  of  an  observation  y^  exceeds  the  magnitude  of  an  observation  yQ+j . 
This  detector  can  be  implemented  using  digital  techniques. 

/  Q  N 

Mann  and  Whitney  have  shown'  '  that  V_^  has  asymptotically  a  normal 
distribution  when  is  true  if  P(y)  is  continuous  and  limit  of  2 

(to) 

exists  as  m,  n  approach  infinity.  Lehman'  has  shown  that  V  has 

nm 

asymptotically  a  normal  distribution  when  is  true  if  P(y)  and  P2(y) 
are  continuous  and  if  the  limit  of  —  exists  as  m,  n  approach  infinity. 

In  reference  (l8)  it  is  shown  that 

W  -  / F(jr) 

tv„l  -  (*§£)  *  (.-1)  («-«!>  +  (»-l)  <^-cE) 

-  (mfn-l)*2 


(*•-63 ) 


(4-64) 


(4-65) 


where 
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/-|-/p(r)  ®,(r) 
'i  •  3  -  / 

e2  =  |  -  J'  [1  -  Pz(y)]  2  <JP(y) 

when 


z  ■  0 

Eo  IVJ  ■  \ 


[VJ 


(ttfn-H) 

1  ?nm 


(4-66) 

(4-67) 


l 

12n 


if  m  >7  n 
a  »1 


Thus,  the  false-alam  probability  of  the  Marm-Whitney  detector  is  indeed 
independent  of  P(y ),  since  <*  depends  only  on  the  seen  and  variance  of 
the  test  statistic  under  Hq,  if  the  test  statistic  satisfies  conditions 
(l')  -  (7').  It  is  shown  in  reference  (16)  that  does  satisfy  conditions 
(l* )  -  (7')  if  the  series  expansion  for  P  (y)  and  P„(y)  can  be  performed 
and  if  the  efficacy  of  is  not  zero. 

The  efficacy  of  V,  is  given  by^^ 
mn 


e(V  )  -  — — - 
mn  m+n 


[  Jv  (y)  P(y)  <sy  ] 

I2n  [  J V  (y)  P(y)  <Jy  J 


(4-68) 


if  m  »n 
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The  Mann-Whltney  detector  Is  particularly  veil  suited  to  detection 
problems  In  which  one  of  the  random  variables  is  stochastically  larger 
than  the  other.  Thus,  the  Mann-Whltney  detector  Is  very  effective  when¬ 
ever  the  y^'s  are  stochastically  larger  than  the  yQ+ ^ ' s  e.g.,  translation 
alternatives,  noncoherent  detection  problems. 

k.l^.l  The  Detection  Problem  of  Translation  Alternatives 
for  translation  alternatives 

pz(y)  *  p(y-z)  (4-69) 

where,  the  mean  and  variance  of  the  random  variable  with  pdf  p(y)  are 
zero  and  one,  respectively. 

It  should  be  noted  here,  that  the  asymptotic  relative  efficiency  of 
any  detector  with  respect  to  the  likelihood  detector  must  necessarily  be 
less  than,  or  at  most,  equal  to  unity.  That  is,  any  detector  that  has  the 
same  eC  and  p  as  the  likelihood  detector  must  use  a  larger  number  of 
samples  or  it  must  take  a  longer  time  for  It  to  decide. 

However,  if  the  ARE  of  the  non-likelihood  detector  with  respect  to 
the  modified  likelihood  detector  L  is  obtained,  for  those  cdf's  for  which 
L*n  is  not  the  optimum  test  statistic,  then  the  ARB  can  be  anything  from 
zero  to  infinity. 

for  translation  alternatives  the  efficacy  of  V _  is^^ 

ran 

'<T»>  -  if  [/  P2(r>  V  j  e-TO) 

2  l2 

P  (y)  dy  If  m»n 

Hence,  the  ARE  of  the  V  detector  with  respect  to  the  t  detector  for 

ran  n 

translation  alternatives  Is,  if  a  »n^®^ 

rv>t(p)  *  &  \J  p2(y)  ay  ] 


(k-7l) 
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In  particular  for  the  DC  detection  problem,  p(y)  ■  0g(y),  thus, 


yt(0o)  -  12  [  J  (2*)-1  exp  (-y2)  dy 


(4-72) 


=  0.9551! 

It  is  seen  that  the  ARE  is  very  high  for  the  DC  detection  problem  for 
which  the  t  modified  likelihood  detector  is  optimum!! 

Ey  ^(p)  can  be  very  large  and  the  minimum  possible  value  of  it 
T  Oft 

is  Y25  *  0.865  and  occurs  for  the  density  p(y)  given  by 
p(y)  «  ^  (5-y2)  y2  *■-  5 


(21) 


(4-73) 


=  0  otherwise 

For  the  case  of  the  noise  having  a  Rayleigh  distribution  that  is  when 

-y2/*  2 


p(y)  *  -?  e 


2  4“ 


when  signal  is  absent 


(4-74) 


and 


P-(y)  “  V  e  2 

z  H2  2n2 


when  signal  Is  present 


(4-75) 


and  for 

2  1 


0.43 


or  tf“«l 


then 


“  [/  »  J 


(4-76) 


3.48 


Thus,  the  use  of  the  Mann- Whitney  detector  Instead  of  the  modified 
likelihood  detector  t  for  the  problem  of  translation  alternatives  does 
not  entail  a  serious  loss  of  information  rate. 
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4.13.2  lfce  Noncoherent  Detection  Problem 
For  the  noncoherent  detection  problem  e(Tm)  le 

•OUJ-SP  [/fTjWer]' 

-  [/  2y3  «p(V>  ay  ] 

»  3  an 
*  4  m+n 


(4-77) 


=  0.75  n  if  «»n 

Eius,  the  ARE  of  the  Mann-Whltney  detector  with  respect  to  the  V  modified 
likelihood  detector  is 


L  ,,  =  O.75  for  m»n  (4-78) 

v,tQ 

Since  the  Mann-Whitney  detector  satisfies  conditions  (l * )  -  (7')  then 
for  z — >0  (weak  signals)  It  obeys  the  performance  relation 


SS  -  2[erf'1  (1'“  m)  *  "f"1  l1’2^]” 


or  for  maximum  Information  rate  m»n  and 


(4-79) 


Kz2  n 


2l  erf"1  (l-aa  )  +  erf' 


-1 


an' 


(4-80) 


The  above  relation  Eq.  (4-80)  has  been  plotted  In  Figs.  (4.3),  (4.4) 
and  (4.3).  In  particular,  defined  as 
P#  »  a  +  p 

is  plotted  vs.  the  signed- to-nolse  ratio  z  (or  S/H),  for  various  values  of 
the  number  of  saaples  (observations)  n  and  for  a>?n. 


(4-81) 


P»  ■  Prob.  of  Error 
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Pe  vt.  S/N 


O  0.1  0.2  0.3  0.4  O.S  0.6  0.7 

Signol/Noito  Rotio 


PROBABILITY  OP  ERROR  V3.  SIOHAL-TO'MOISB 

RATIO  TOR  0AU3SIAN  NOISE 
PlOUIffi  4.3 


Pe"Prob.  of  Error 
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Pe  vs.  S/N 


PROBABILITY  OF  ERROR  VS.  8ICHAL-TO-NOISZ 
RATIO  FOR  RAXLEHH  NOISE 
FIGURE  4.4 


•  LIKELIHOOD  DETECTOR 
■  MANN -WHITNEY 


NON-COHERENT  DETECTION 
OF  SINE-WAVE  IN 
NORMAL  NOISE 


Signal  /  Noise  Ratio 


PROBABILITY  OP  ERROR  V3.  SIONAL- TO- NOISE  RATIO  IOR 
THE  PROEUJt  OP  NOR- THERETO  DETECTION  OP  OIME-HAVE 
IN  QAUSSIAN  NOISE 

FIGURE  4.J 
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4.13.3  Detection  of  lonstatlonary  Signals  In  Noise 
In  all  the  detection  problems  thus  far  considered  It  was  assumed  that 
the  peak  slgnal-to-ras-noise  ratio  remained  constant  In  time.  In  many 
practical  situations  as  In  scatter  propagation  this  assumption  Is  not 
Justified.  The  noise  H(t)  Introduced  in  the  channel  is  a  sample  function 
of  the  continuous  stochastic  process  (N(t)}.  Here  it  is  still  assumed  that 
(N(t)}  is  stationary.  Thus,  the  cdf  of  yQ+j  j=l,  . ..,  m  is  still  P(y). 

The  continuous  stochastic  process  (T(t))  is  not  stationary  when  signal 
Is  present  when  the  signal  strength  varies  with  time.  Thus,  the  cdf  of 
y^  1=1,  ...,  n  differs  from  the  cdf  of  yj  J=l,  ...,  n  and  J  /  1. 

The  detection  criterion  for  the  detection  of  nonstationary  signals 
In  noise  (e.g.  when  Baylelgh  fading  is  present  In  the  channel)  Is  equi¬ 
valent  to  testing 

cdf  of  y^  is  P(y)  1=1,  ...,  m+n  signal  Is  absent 

against 

:  cdf  of  yA  is  ?z  (y),  1=1,  ...,  n  and  the  cdf  of  yQ+j  is 

P(y),  J  =  1,  . ..,  a  signal  Is  present 

where  sane  but  not  all  of  the  z^  are  allowed  to  be  zero.  The  above 

(22  ) 

hypothesis  testing  problem  is  discussed  by  Noether. 

The  mean  and  variance  of  the  Mann-Vhltney  detector  for  the  above 
hypothesis  Is 


n 

IV!  ■  n  I  /*<*>  V  W 

J  1  1 


(4-82) 


1=1 

assuming  the  series  expansion  of  P  (y)  is  possible  for  all  1=1,  .. 

Z1 

then 

pz^(y)  -  p(y)  +  *£  To*  (y)  +  o(zt)2 


(4-83) 
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vhere 


pz(y) 


z  ■  0 


thus. 


•  n 

\  ^Visd^  *  n  Z  f  p(y)  tpfr)  +  zi  b'(y)  +  °(zi^  dy 


i«l 

n 


=  I  ^  +  n  y  zi  f^'^)  ** 

i*l  ra¬ 
il  n 

-  n  Z  /  ™  dP<y)  +  {  K  Z  *i}  /fc'(jr)  r(!,)  *■ 


i-1 

n 


n  Z  I  +  zf  V<y>  P(y)  ^ 


i=l 


where 


=  a+zf  p(y)  ** 

n 

i  Z* 


i*l 

The  mean  and  variance  of  the  Mann-Whitney  statistic  remain  as  before; 

thus, 

W  ■  I 

.2  rv  i  ,  st£„ 

0  0  1  mnJ  12mn 

torm»n 

and  in  the  weak  signal  case  when  the  z^  are  very  small,  then  it  can  be 
shown^^  that 


s\  (V.J  ■  ff\  <V 


(4-8k) 


(^85) 

(k-86) 
(h— 87) 


(4- 88) 
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It  is  concluded  from  the  store  that  all  the  results  obtained  previously 
and  pertaining  to  the  Mann-Vhltney  detector  are  applicable  when  the  signal 
is  nonstatlonaxy  (e.g.,  Bayleigh  finding  in  the  channel)  by  substituting 
for  z  the  are rage  z  defined  by 
n 

I  -  |  (**-89) 

i-1 

thus, 

Xz2  n  ■  2  ^erf’1  (1-20^)  +  erf”1  (1-20^ 

for  n>>n 

where  X  has  been  defined  as 

X  -  i  e^)  (4-91) 

-12  [J  b'(y)  P(y)  dy  J 

If  J b'(y)  P(y)  dy  is  known,  then  the  only  information  needed  to  obtain 
the  sample  size  n  in  order  to  detect  a  nonstationary  signal  in  noise  with 
accuracy  a,  0  is  the  average  signal- to- noise  ratio  parameter  z.  She 
parameters  z  and  K  may  be  obtained  experimentally  for  any  particular 
pair  of  signal  and  signal  and  noise  distributions. 

4.14  Bie  Kolmogorov- anirnov  Detector 

5he  Kolmngorov-Bmirnov  detector  is  based  on  the  test  statistic  K^(y) 
defined  as 


>T 


(4-90) 


- 


(4-92) 
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The  functions  T  (y)  and  8  (y)  are  the  empirical  distribution  functions  of 
n  m 

the  samples  y^,  . . . ,  yQ,  and  y^ ,  . . . ,  yn[m>  respectively,  and  are  defined 
as  follows 

TQ(y)  “  “  number  of  y^'e  in  the  sample  y^  ...,  yQ  that  are  less  or 
equal  to  y 

Sm(y)  =  j  number  of  yQ+ j ' s  in  the  senile  yQ+1,  yn+m,  that 

are  less  than  or  equal  to  y 

The  asymptotic  distribution  of  ^^(y)  under  Hq  was  shown'  ~>1  to  be 
***  [  &)1/2  *tan(y)-x]  “ 

CO 

*  1  -  2  ^(-l)J_1  e*p  (-2J2x2)  (4-93) 

j=l 

if  x  —  0 

=  0,  if  x  ^  0 

provided  P(y)  is  continuous  and  that  the  limit  of  jjj  exists  as  m  and  n 
approach  infinity.  It  is  noted  that  the  limiting  distribution  in  Eq.  (4-93) 
is  independent  of  the  form  of  P(y),  so  that  the  false  alarm  probability 
of  this  test  is  independent  of  P(y). 

The  asymptotic  distribution  of  K_(y)  when  signal  is  present  has  not 

OQQ 

yet  been  investigated  and  in  general,  it  is  extremely  difficult  to  obtain. 

(24) 

However,  Massey'  has  shown  that  an  upper  bound  for  the  false  dismissal 
probability  of  the  K  and  S  detector  is 

42  2 

(2*)  -1/2  f  exp  (-  %)  dx  (4-94) 

*1 
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vnere 

_ _ d  - 

^ '  r  p(>0)ti-F(x0)i  |  pt(xe)[i-?z(io)i  i 
x _ a*  &/z  ^ 

2  ‘  [  P(x0)[l-P(x0)l  |  »,U0)[l-?,(x0)1  j  1/2 

d  .  nax  I  Pz(x)  -  P(x)| 

•  !  Pz<*o>  -  X*o,l 

and  determines  the  critical  region  of  f&lse-alarm  probability  <*  and 
ia  given  by 

»«*>•  [  >*«]-* 

The  probability  distribution  given  in  Eq.  (4-93)  has  been  published  by 
(25) 

Stalrnov'  .  This  table  permits  one  to  find  the  critical  values  K 
very  easily. 

The  largest  p  occurs  for  Xg  being  largest  and  1^  being  smallest 
possible.  When  m  and  n  are  very  large  then  Xg  is  almost  infinity.  The 
smallest  X^  for  fixed  d  occurs  vhen 

P<xo>  -  m  & 


(4-95) 


(4-96) 
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thua, 

H  ■  2  [  4  (^>V2  -  **.]  (*^9T) 

So  the  upper  bound  of  0  is  given  by 

*2 

pan  -  <2*>  ’1/2  f  exp  (-x2/2)dx  (4-98) 

X1 

where  1^  is  given  by  Eq.  (4-97) 

It  is  seen  fro*  Eq.  (4-97)  that  1^  approaches  infinity  as  m  and  n  approach 

infinite .  Thus, 

limit  B  »  0 
mn 

a— ►oo 

n— *•  (4-99) 

which  means  that  the  KoMogorov-Staimov  detector  possesses  the  important 
property  of  consistency.  Note  that  this  is  true  for  all  continuous  cdf's 
P(y)  and  Pz(y). 

The  statistic  does  not  satisfy  condition  (l)  so  it  is  not  possible 
to  use  the  methods  developed  in  Part  I  to  obtain  the  asymptotic  relative 
efficiency.  However,  one  may  proceed  as  follows.  The  relation  between  K#  , 
and  o<  is  given  by  Eq.  (4-93) 

00 

2  Y  (-l)J-1  exp(-2J2  X2)  -  (4-100) 

>1 

When  <K  is  small  then  is  large  so  that  in  the  series  expansion  of 
Eq.  (4-100)  the  only  significant  term  is  that  for  J  ■*  1. 
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Thus, 


K 


[?  ^l] 


1/2 


The  upper  bound  for  the  false  dismissal  probability  0  is 

CO 

v-1/2 


0  <  (2 *)_1/2  |  exp  (-x2/2)  dx 


or 


M I  • ert  '  I  i1  • erf  [  ^775“  ] } 

vhich  because  of  Eq.  (4-97)  becomes 
a  ]1/2  - 


(2)J 

adding  Eqs.  (4-101)  and  (4-103)  yields 

1  V2  , 


2  am 
1  iTn" 


'{Li  “  s 


(2) 


172 


erf 


'1(l-2p)  j 


The  quantity  d  can  be  obtained  for  translation  alternatives  and  for  very 
small  z,  (weak  signals),  as 
d  «  max  |  ?z(y)  -  P(y)  | 

-00  <  y  <  00 

-  max  |  P(y-z)  -  P(y)  | 

-»  <  y  <» 

-max  limit  ■[  z[  ]  \ 

y<»  z— *  0 

Assuming  that 

limit  ?(y*z)  ~  p(y)  „  p(y ) 
z 


(4-101) 


(4-102) 


(4-103) 


(4-104) 


(4-105) 


(4-106) 


z — +0 


exists  for  all  y,  then 
d  *  z  max  p(y) 


-»  <  y  <  «>  translation 
alternatives 

-zMf 

where 

Mf  =  max  p(y) 

-»<y<  * 

Thus,  Eq.  (4-104)  becomes 

■v  a  <{«*£.§>*♦  #>*«**  («•>}* 

For  the  likelihood  detector  It  was  found  that 
e(tQ)  *  n  for  translation  alternatives 

or  K  -  1 

thus  for  the  t&  -  test  and  for  translation  alternatives  the  following 
relations  obtain 

z2  n  *  2  ^  erf"1  (l-2a)  +  erf"1  (1-23) 

In  Part  I,  It  was  defined  that 

*k-t  ■  *«■*  b 

z  -a  0 

where  both  tests  are  for  the  same  value  of  z  and  accuracy  a,  3.  Thus, 
a  lower  bound  for  E^  t  may  be  obtained  as  follows 

where  m*,  n*  are  the  number  of  samples  for  the  Kolmogorov-Sad. raov 
detector,  and 


(t-107) 


(4-108) 

(4-109) 


(4-110) 


(4-111) 


(4-112) 


(4-113) 
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«<«,»>  -  t'f'W  * 

lU.  n  |)1/2  +  erf^U-Sp))2 


t  is  as  large  as  possible  when  n*»  n*  sad  then 

***4  »>>*» 

for  translation  alternatives 

Thus,  for  the  various  problems  discussed  before  it  follows  that 
4.14.1  DC  Detection  Problem 


p(y)  *  0o(y)  a»d  IL  -  (2*)"1/2 

so 

E^t(p0)  >  |  Q(a,p)  -  0 .64  q(a,p) 

-3 

For  a  value  of  a  ■  p  =  10 

VWo>  £  0.50 

and  for  a  »  p  =  10~^ 

Vt^o>  -  °‘55 

The  above  values  are  sufficiently  high  to  warrant  use  of  the  Kolmogorov- 
Smirnov  detector  whenever  this  detector  is  appropriate. 

4.14.2  Translation  Alternatives 

It  is  shown  in  reference  (16)  that  a  lower  bound  for  ^  for  trans¬ 
lation  alternatives  exists,  and  it  is 


V  2  3  ,(a-f>) 

-3 

which  for  a  ■  p  ®  10  becomes 
\,t  2  °‘26 


(4-114) 

(4-115) 


(4-116) 
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4.14.3  Baylel^h  loise  Detection  Problem 
For  this  problem  one  obtains 

4M^  -  9.28 

and,  therefore, 

F^t(Kayleigh)>  9.28  Q(a,p) 

-•a 

which  for  a  *  0  ■  10  becomes 
®j[^t(8*ylel^i)>  7*3 

*:.14.4  noncoherent  Detection  Problem 

It  can  be  shown  easily  for^^the  noncoherent  detection  problem  that 

Q(<*,0)  m»n 

which  for  a  =  0  *  10-^  becomes 

Vt*  °*te 

and  for  a  »  p  »  10"^  becomes 

V-0*47 

4.15  Bank  Detectors 

The  rank  detectors  to  be  discussed  In  this  section  are  optimum  In 
the  sense  that  for  a  given  a,  m,  and  n  they  have  the  smallest  0  aausa g 
all  size  -a  rank  tests.  It  should  be  stressed  that  these  detectors  are 

optimum  only  for  a  particular  pair  of  cdf's  P(y)  and  P  (y). 

(oc\  Z 

It  has  been  shown'  'that  if  p  (y)  is  greater  than  zero  whenever 

z 

p(y)  is  greater  than  zero,  then  the  optimum  rank  detector  of  H'q  against 
is  based  an  the  statistic 


(4-117) 

(4-118) 

(4-119) 


(4-120) 


E„ 


p*  yiy, 


/  P(s 


HI 


iy 


HI 


where  y.  is  the  i-th  smallest  of  the  combined,  sample  y, ,  . ...  y  and 
l  x  n+m 

y^  is  defined  as 


if  y±  falls  in  y^  ...,  yQ 
if  yt  falls  inyn+1,  —,7^ 


where  H  =  n+m 

Por  weak  signals,  z  Is  very  small  and  substituting  the  series  expansion 

for  P  (y)  in  Eq.  (4-120)  we  obtain  an  equivalent  expression 
z 


R* 


mn 


yHi 


Where 

“hi  •  Eo  [  v  ] 


In  order  to  use  we  must  know  the  numbers  a^.  These  are  very 
difficult  to  compute.  The  function  b'(x)/p(x)  is  found  from  the  particu¬ 
lar  pair  of  cdf's  P(y)  and  P  (y)  for  which  the  rank  detector  is  optimum. 

z 

The  complexity  of  the  function  b'(x)/p(x),  and  of  the  cdf  P(y)  determine 
whether  it  is  feasible  to  obtain  the  numbers  a^. 

It  can  be  shown^^  that  E»  satisfies  conditions  (l' )  -  (7')  if  the 
integral 

f  |*'2(y)/p(y)J  dy 

is  bounded  and  if  b'(y)  is  not  identically  zero. 


(4-121) 


The  aean  and  variance  of  are 


B0(^)  -  J  V(y)  dy  -  0 

(4-122) 

<ro(^n)  *  STi  7"[b,2<ar)/p(3r)  ]  * 

(4-123) 

Also  the  efficacy  of  can  be  shown^^to  be 

•<■£>>  ■  f  f*&  » 

-  n  v2(y)/p(y)  J  dy  *>>n  (4-124) 


The  asymptotic  relative  efficiency  of  with  respect  to  the  like¬ 
lihood.  detector  L*  was  proven^  ^to  he 


Ejj,  -  1  for  m»n  (4-125) 

Eq.  (4-125)  above  states  the  extremely  important  fact  that  the  rank 
detector  based  an  R*  has  the  same  information  efficiency  as  the  like- 

BOX 

lihood  detector  based  on  LJ,  when  the  efficiencies  are  calculated  for  the 
particular  pair  of  cdf's  P(y )  and  P  (y)  for  which  both  detectors  are  op- 
timum.  Moreover,  the  rank  detection  has  the  additional  advantage  that  its 
false  alarm  probability  does  not  depend  on  the  actual  cdf  of  the  y^'s 
under  no  signal  conditions. 

4.15.1  DC  Detection  Problem 

For  this  detection  problem  the  statistic  S*^  takes  the  font 

M 

*£n  (yKL;  W  “  n  Y 

1-1 


B0  tyi]  yHi 


(4-126) 
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where  E^y^)  Is  the  expected  value  of  the  i-th  smallest  observation  of  a 

sample  of  N  from  the  standard  normal  distribution. 

It  has  been  shown ^^that  E_*  ^Is  always  greater  or  equal  to  one 

wt, 

and  equals  one  only  If  p(y)  is  the  standard  normal  density.  Thus,  it  Is 
always  more  efficient  to  use  than  the  likelihood  detector  based  on 
tn,  for  the  problem  of  translation  alternatives. 

4.15.2  Translation  Alternatives 

It  can  be  shown  that  an  upper  bound  for  the  sample  n  exists,  and  it  is 

n ^  ~2~  [erf-1  (l-a^)  +  erf’1  (1-2^)]  2  m»n  (4-127) 

for  translation  alternatives  and  for  R*  as  given  by  Eq.  (4-126). 

nin 

4.15.3  noncoherent  Detection  Problem 

Fbr  this  problem  an  equivalent  statistic  for  R*  is  T _  defined  as 

mn  mn 

H  H 

Tm  (ym;  ;  X  y»i  X  ^  <l*':l28) 

i=l  J=H+l-i 

According  to  Eq.  (4-125)  the  nonlikelihood  detector  based  on  Tmn  has  the 
same  information  efficiency  as  the  likelihood  detector  based  on  t'.  In 
addition,  the  rank  detector  based  on  T  has  the  decided  advantage  that 
its  false  alarm  probability  is  independent  of  P(y). 
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5.1  Introduction 

In  ccomuii  cation  system*,  the  transmitted  signal  seems  to  be  that 
part  which  has  until  now  received  the  least  scrutiny  in  the  light  of 
modern  communi cation  theory.  Instead,  most  ccumini cation  system  analysis 
usually  begins  by  taking  for  granted  one  of  the  conventional  modulations, 
or  a  choice  of  signals  is  made  from  a  number  of  traditional  types,  on  the 
basis  of  past  experience. 

Actually,  all  other  factors  being  fixed,  a  suitably  designed  signal 
holds  the  promise  of  transferring  to  the  transmitter  some  of  the  signal 
processing  operations  now  called  for  at  the  receiver  in  order  to  achieve 
near-optimum  reception.  Oils  would  be  of  particular  interest  in  ground-to- 
air  and  ground- to- space  communication.  Aside  from  this,  an  improvement  in 
performance  (error  rate)  of  any  given  system  is  indicated  if  the  trans¬ 
mitted  signal  is  optimized  with  respect  to  the  characteristics  of  the 
channel . 

In  order  to  determine  the  extent  of  possible  improvements  and  to 
examine  some  of  the  problems  involved  in  effecting  such  Improvements,  this 
investigation  of  Signal  Design  was  initiated,  and  the  work  performed  in 
this  area  thus  far  is  reported  in  this  chapter. 

First  comes  a  discussion  of  the  signal  design  problems  which  arise 
in  digital  communication  systems,  with  a  breakdown  into  various  categories, 
according  to  the  constraints  imposed  by  the  system  requirements  and  the 
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channel.  Then  follows  a  discussion  of  the  specific  problem  investigated 
so  far  and  the  results  obtained. 

The  work  so  far  has  been  concerned  with  the  determination  of  optimum 
waveshapes  which  will  not  give  rise  to  intersymbol  Interference  In  a 
dispersive  channel  —  i  .e.,  a  "channel  with  memory”  —  If  the  channel 
characteristics  are  assumed  known.  This  differs  from  other  published 
work  In  signal  design,  as  Indicated  In  section  5.2.  A  very  simple  channel 
model  Is  considered  In  order  that  specific  results  may  be  discussed. 

In  section  5*3>  reference  Is  made  to  recent  literature  on  waveforms 
which  eliminate  intersymbol  Interference,  and  several  simple  examples  of 
such  waveforms  are  presented.  If  the  channel,  transmission  rate,  and 
transmitted  energy  (per  waveform)  are  specified,  many  such  waveforms  can 
be  found,  but  they  will  generally  result  in  different  values  of  received 
energy.  Therefore,  In  section  5*^»  those  waveforms  are  found  which 
maximize  the  received  energy,  given  a  certain  channel.  Such  waveforms 
are  optimum  if  the  receiver  contains  a  matched  filter. 

The  elimination  of  intersymbol  interference  is  accomplished  at  the 
expense  of  signal  energy.  This  trade-off  is  examined  in  section  5*5. 

How  accurately  must  the  channel  parameters  be  known  in  order  to  make 
possible  Mar- optimum  performance?  This  question  is  investigated  In 
section  5.6.  In  section  5*7  it  Is  shown  that  further  optimization  is 
possible  If  the  transmitted  waveforms  are  permitted  to  overlap  somewhat. 

Although  the  results  obtained  thus  far  are  very  interesting.  It  Is 
clear  that  considerably  more  work  is  required  to  illuminate  the  problem  con¬ 
sidered  here  as  well  as  other  applications  of  optimum  signal  design. 


5.2  Outline  of  Problems 
5.2.1  general  Blicueslcn 


One  of  the  problems  Involved  In  the  design  of  a  comnicatlon  system 
Is  the  specification  of  waveforms  to  be  transmitted.  It  Is  a  difficult 
problem  for  the  following  reasons: 

1)  Often  the  most  important  factor  determining  the  optimum  trans¬ 
mission  waveform  Is  the  exact  nature  of  the  transmission  channel,  which, 

In  thecase  of  radio  cmiiii  I  cation,  Is  usually  only  vaguely  known,  and 
in  general  also  varies  considerably  with  time. 

2)  ill  portions  of  the  system  impose  requirements  —  some  conflicting 
on  the  signal  waveform,  making  the  optimization  of  the  signal  waveform 
often  a  difficult,  If  not  impossible  analytical  problem;  also,  a  mathe¬ 
matical  solution,  if  successful,  nay  still  not  be  very  useful  if  It 
results  in  a  waveshape  that  is  difficult  to  generate. 

Of  recent  Interest  are  feedback  comnicatlon  systems.  These 
could  be  arranged  to  measure  channel  parameters  --  continuously,  if 
necessary  —  and  then  to  use  the  channel  estimates  thus  obtained  at  the 
transmitter  for  proper  signal  shaping.  This  Is  a  way  of  overcoating  the 
difficulty  no.  l)  above. 

Bie  purpose  of  the  current  study  Is  to  Investigate  the  marl  ram 
improvements  which  can  be  obtained  by  proper  signal  design  and  thus 
pertains  to  Item  no.  2)  above,  for  this  reason  In  all  subsequent  discus¬ 
sion  It  will  be  assumed  that  the  transmission  channel  is  coavletely  speci¬ 
fied. 

It  should  also  be  pointed  out  that  the  scope  of  this  program  la 
restricted  to  digital  coaaauni cation  systems.  The  situation  under  con¬ 
sideration  may  thus  be  represented  by  the  simple  diagram  In  Tig.  5-1* 
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waveform 
generator 


COMOHICATIQB  SXSZBt,  AS  OOBSUOKED  IB  THIS  CHAPTER 
FIGURE  5*1 

She  waveform  generator  produces  a  train  of  waveforms  e^t)  which  are 
selected  from  a  signal  alphabet.  The  channel  Is  completely  specified;  It 
any  contain  sources  (noise,  Interference),  delays,  and  non- linearities. 

The  "waveform  observer"  Is  a  suitable  device  for  deciding  on  the  trans¬ 
mitted  symbol  from  the  observed  waveform,  eQ(t).  Bote  that  filters  and 
other  networks  following  the  waveform  generator  and  preceding  the  wave¬ 
form  observer  can  be  conveniently  lumped  into  the  channel. 

5.2.2  F&ctors  Which  Determine  the  Transmitted  Waveforms 

In  any  given  communication  system,  a  number  of  requirements  restrict 
the  types  of  signals  to  be  considered  for  e^(t).  Often  the  requirements 
combine  to  limit  e^(t)  to  only  a  single  pair  of  (binary)  waveforms.  These 
requirements  can  be  grouped  for  convenience  Into  three  basic  categories: 

A)  The  exact  nature  of  the  channel 

B)  The  performance  criterion 

C)  Specified  constraints  concerning  the  transmission  and  reception 
processes . 

Typical  examples  of  each  category  follow. 


I 


5.2.2 .1  The  Quumal 
Various  ways  In  which  a  channel  Bay  act  on  a  signal  are: 

a)  Dispersion,  representable  by  transmission  through  a  lumped 
constant  network 

b)  Dispersion,  representable  by  transmission  through  a  distributed 
constant  network 

c)  Multipath 

d)  Honlinear  operation,  as  In  the  case  of  Doppler 

e)  Sene  combination  of  the  above 

These  effects  are  present  to  various  extents,  regardless  of  the  noise;  so 
that  In  conjunction  with  any  of  the  abore  cases  might  be  considered 

a)  No  appreciable  noise  or  Interference  present 

b)  loise  of  specified  statistics  present 

c)  Specified  Interfering  signals  present 

5.2 .2 .2  The  Performance  Criterion 

This  must  be  determined  In  the  case  of  any  comnunl cation  system 
design  and  depends  on  the  nature  and  purpose  of  the  system.  Sometimes 
severed  criteria  are  to  be  satisfied. 

Examples  of  such  criteria  are: 

a)  Minimisation  of  Inter symbol  Interference 

b)  Minimization  of  adjacent  channel  Interference 

c)  Minimization  of  error  rate 

d)  Minimization  of  cost,  If  suitably  defined 

5. 2. 2. 3  Constraints 

These  are  additional  requirements  for  the  communication  system  which 
are  Initially  specified.  They  may  be: 


-85- 

a)  Alphabet  size.  A  binary,  ternary,  or  larger  signal  alphabet  nay 
be  apeelfled. 

b)  Signaling  rate.  A  certain  fixed  rate  nay  be  apeelfled. 

c)  Restrictions  regarding  the  generation  of  vave forms  nay  be  given, 
such  aa  maximum  bandwidth,  marl  mum  average  signal  power,  maxi¬ 
mum  peak  power. 

d)  The  detection  system  nay  be  specified  as  coherent,  or  Incoherent; 
maximum  permissible  delay  or  storage  capacity  at  the  receiver  may 
be  specified. 

e)  The  allowable  degradation  In  system  performance  resulting 

from  specified  changes  In  certain  system  parameters. 

5.2.3  Problems  Investigated  in  the  Past 

Considerable  work  has  already  been  done  for  ease  of  these  cases  by 
a  number  of  Investigators. 

Optimum  signals  to  be  used  In  the  presence  of  white  and  colored 
Oausslan  noise  have  been  determined  for  channels  representable  by  linear 
constant  parameter  networks  for  the  case  where  the  duration  of  each  signal¬ 
ing  element  is  substantially  larger  than  the  significant  part  of  the  channel 
Impulse  response,  as  discussed  by  Middleton  (Ref.  27,  Chapter  23)  and 
Lerner  (Ref.  28,  Chapters  8  and  11).  Signals  suitable  for  use  with  multi- 
path  channels  have  been  found  to  be  maximal  length  binary  shift  register 
sequences,  as  discussed  by  Price  and  Green  (Ref.  29).  Transmission  with 
Doppler  has  primarily  been  Investigated  in  connection  with  Radar  (Refs.  30 
and  31)  which  gives  rise  to  different  requirements  than  a  communication 
link  because  the  pertinent  Information  In  the  received  radar  signal  is 
its  delay. 


-86- 


5.2.4  Specific  Problem  Conalgeged  in  this  Chapter 

Discussion  henceforth  Is  United  to  channels  representable  by  linear 
lunped  constant  networks,  with  addltlrs  Gaussian  noise  of  constant  spec¬ 
tral  density.  Vo  restriction  on  signaling  rate  is  imposed.  The  criterion 
a),  minimization  of  intersynbol  interference  is  applied  first.  This  is 
then  combined  with  criterion  o),  ninlnizatlon  of  error  rate,  which  In  the 
presence  of  Interfering  white  Gaussian  noise  lulled  m^mhi  energy  trans¬ 
fer  through  the  channel.  An  arbitrary  fixed  signaling  rate  is  as suned. 

5.3  CcBpieta  xn»inatiftM  of  Intersynbol  Interference 

It  has  been  shown  by  Qerst  and  Diamond  (Bef.  32 )  that  in  the  case  of 
puloe  transmission  through  linear  lunped  constant  networks,  intersynbol 
Interference  can  be  coaqpletely  eliminated  by  the  use  of  appropriate 
signaling  ware  forms .  They  also  show  how  to  find  such  waveforms,  given 
the  transfer  function  of  the  network  under  consideration.  Section  5. 3.1 
is  a  summary  of  the  results  obtained  by  Qerst  and  Diamond  which  are 
pertinent  to  the  problem  under  consideration.  The  word  "pul8®"  1®  used 
In  the  following  and  subsequent  sections  to  mean  a  waveform  which  is  non¬ 
zero  only  In  a  specified  finite  time  Interval. 

5.3.1  Waveforms  which  Achieve  Complete  Elimination  of  Intersynbol 
Interference 

a)  Tor  any  lumped- element  constant  parameter  network,  there  exist 
input  pulses  of  arbitrary  length  a,  such  that  the  corresponding  outputs 
of  the  system  are  pulses  of  the  same  length  a. 

b)  Pulses  which  satisfy  a)  may  be  constructed  by  one  of  the 


following  methods 


-87- 


Methodl: 

file  Iaplace-tranafor*  I^(s)  of  the  desired  input  pulse  of  duration 
a  is  giren  by 


ma  -  max(a, )  ^ 

1  -  exp  [ - 5 - (e-  rj)]|  j 


(5-D 


#  1  k 

where  0(e)  is  an  entire  function  of  the  form  ^  €  _ai8P^(s)  , 

i-1 


Pt(s),  i-1,  ...,  k,  and 

D(s )  being  polynomials  in  a,  with  the  P^(s)  of  lower  degree  than 
D(a), 

a^,  i  -1,  k  are  non-negative  real  numbers  smaller  than  a,  and 
fry  J  -  1,  . ..,  n  are  the  n  poles  of  the  network  transfer  function. 
The  slap lest  function  satisfying  the  requirements  for  0(s)  is,  therefore. 


* 


0(s) 


1— € 


(5-2) 


is  the  transfer  function  of  the  net¬ 
work  where  Din  and  hQ-  1, 


i»o 

then  we  have  for  the  input  pulse,  e^(t),  and  the  associated  output  pulse 

®0(t): 


*  An  entire  function  is  a  function  of  a  complex  variable  which  is  analytic 
and  has  no  singularities  in  the  finite  plane. 
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e^t)  -  h0«1(t)  +  h^t)  +  . + 

e0(t)  -  Vi<t}  +  Vi^ + . +  Vi<a)(t)i 

where  e^(t)  Is  a  pulse  which  has  the  specified  duration  and  Is  differ¬ 
entiable  n  tines. 

5.3.2  Specific  Essnples 
5.3.2 .1  BC  Low-pass  letwork 

a)  Given  the  following  network,  which  has  the  transfer  function 
“  s+5  •  *  “  BC  : 


I  (5-3) 


e 

) - W\A/ - 

f - o 

j 

c  s 

k 

ei(t) 
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y -  -H 

L 

•o(t) 


RC  LOW-PASS  REWORK 
FIGURE  5.2 

Rjr  method  I  of  section  5.3.I,  using 
"  2  “  -  \  a(s+  ot) 

- (l-«  3,  (5-^) 

the  following  Input  and  output  functions  are  obtained,  where  u(t)  Is 
the  unit  step: 

-  |o(a  -  iota 

eA(t)  » u(t)-(l-c  )  u(t-  | )  +  «  u(t-a)  j  (5-5) 

«0(t)  -  (l-.***)  u(t)-(l-.'  J **)(!-«■***  •  5  f) 

"iota 

♦  .  (I-.'* 


)  u(t-a)  . 


(5-6) 
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Sketches  of  those  functions  for  typical  -values  of  a  A  are  shown  In 
Kg.  5*3* 

b)  If,  Instead,  1^(8  )  Is  chosen  to  be 


V«)  - 

then  a  typical  pair  of  input-output  ware  forms  is  the  one  shown  in 
Fig.  5.t  for  the  case  a<  »  1.  The  Input  pulse  is  now  continuous. 

c)  Applying  method  II  to  the  SC  low-pass  network,  one  notes  that 
the  input  and  output  ware  forms  are  of  the  font 
•±(t)  -^(t)  +  e£(t)  , 

► 

eQ(t)  -o^e^t)  i 

where  e^(t)  is  a  pulse  ware for*  which  must  be  a  differentiable  function 
of  time. 

▲  suitable  function  to  be  used  for  e^(t)  is 


(5-7) 


(5-8) 


2rt  \2 
a  ;  * 


0  t  t  £  a 
otherwise  . 


(5-9) 


With  this  choice  for  e^(t),  the  following  input  and  output  functions 
result: 


ei(t)  .*(!.«. .  is  (.ijBt .  2  ; 

«0(t)  -  eCjl-CO.2**)2  , 


For  several  values  of  a«c,  the  waveforms  are  shown  in  Fig.  5*5* 


(5-10) 

(5-H) 
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5. 3.2 .2  ILC  Loir-pass  letirorh 

a)  The  ILC  network  shown  helosr  is  coasldsrtd  next.  So  he  specific, 

assumed.* 


•4<t) 


►— 0 

11  l  1 

a 

o 

1L 

c 

1 

0—  . . — . . . —  ■  . 

. .  ■  0 

•0(t) 


ILC  LSV-Pitt  BWOM 

noon  5.6 


2dr  w  i 

The  transfer  function  is  E(s)  ■  9  *■  9>  where  *  ■ 


2  2* 
s  +2s*+2* 


hy  method  I,  using 


K  (.)  .k« - !  (1.c-(*/3)[^(l+J)])(l.s-(*/3)[«^(l-J)])  # 

1  8 

the  input  and  output  pulses  are: 


et(t)  -  u(t)-(l+2c“aM/3co^)u(t-  |He-2a<</3+26-M/3co^)u(t-  S§) 
-  «-2aa/3  u(t-a)  , 

eo(t)  -  h^t)  -  (l+2«"a^3cos  *|)  h_1(t-  i)  + 

(e’2a^3+2c‘aa/3cosfi|)h.1(t-  Si)  -e"2a'^3h_1(t-a). 


(5-12) 


(5-13) 


(5-1^) 


*  Oils  example  la  also  presented  in  Bef.  32 • 


I 

I 

I 


1 

f. 

! 
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where 


h^t)  »  u(t)[l-«’***(coe  <*t  +  sin  *t)] 
typical  waveforms  are  shown  in  Fig.  5*7* 

h)  Method  II  Is  now  applied  to  the  saae  network,  and  the  sane 
auxiliary  function  e1(t)  is  chosen  as  was  used  in  section  5*3*2 .1. 

The  resulting  input  and  output  functions  are: 

.  „Jat) , 

flt 

oat  a  a. 

eo(t)  -  2*2(i-cos  ,  Oi  t  a  a. 

The  ware  fonts  are  again  plotted  for  several  values  of  a*  In  Fig.  5*8* 
5.3.3  Pulse  Transmission  Efficiency 

Since  for  any  given  network  a  wide  variety  of  Input  pulses  result  in 
output  pulses  of  the  same  duration,  which  of  these  input  pulses  are  to  he 
preferred  over  other  such  input  pulses?  The  answer  to  this  question  in 
general  depends  on  additional  specifications  regarding  the  ccasunl cation 
system,  such  as  are  listed  in  section  5*2.2.  In  the  specific  case  under 
consideration  as  outlined  in  section  5*2.3,  however,  it  is  desirable  to 
maximize  the  received  energy,  which  will  minimize  the  error  rate  in  the 
case  of  a  matched- filter  receiver. 

A  convenient  concept  for  this  purpose  is  the  npulse  transmission 
efficiency,"  n  ,  defined  as  the  ratio  of  the  "energy  contents"  of  the 


(5-15) 


(5-16) 

(5-17) 
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•|(t) 

I  JO 


zm^ouvov  nut  pazm  maum  a  ammo*  ).).u  <•) 
nous*  5.7 


! 


output  and  input  pulse  waveforms,  each  on  a  "one -ohm  basis" s 


I. 


*  e*  (t)  dt 


(5-18) 


The  lapll cation  is  that  the  network  representing  the  channel  does  in 
fact  not  present  a  frequency- dependent  input  impedance  to  the  waveform 
generator,  (Fig.  5.1)  and  the  waveform  observer  does  not  load  the  channel 
output.  Tbe  latter  condition  can  always  be  naintained  by  incorporating 
in  the  network  representing  the  channel  any  loading  at  the  channel  output. 
The  former  condition,  however,  applies  only  if  the  waveform  generator  is 
suitably  de-coupled  from  the  channel,  as  would  be  the  case  in  a  radio 
transniseian.  Fig.  5*1  might,  therefore,  be  specialized  to  the  following 
normalized  form  Where  the  amplifiers  have  unit  gain.  Infinite  input  im¬ 
pedance,  zero  output  impedance: 


1 

_ L. _ J 

Hetvork 

Ok«>  $ 

1  ohm 

;> 

representing 

channel 

wave  fora  1 

V 

generator  * 

Channel 

j> 


t 


1  ohm 

| _ vaveform_ 

observer 


Mii—flarc  of  noon  5*1 
HOOKE  5*9 


r  *i  <*>  *• 


the  energy  supplied  by  the 


Using  this  representation. 
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wavefor*  generator,  and  J  e^  (t)  Is  the  energy  delivered  to  a  waveform 

observer  which  has  1  ohm  ljgmt  impedance. 

5. 3. 3.1  n  for  the  Waveforms  Considered  In  8ectlon  5*3*2. 1 

dree  types  of  input -output  pulse  pairs  were  considered  for  the 
SC  low-pass  network,  tinder  a),  b),  and  e)  In  section  5.3.2 .1.  de  pulse 
transmission  efficiencies  for  these  three  types  are  plotted  in  Tig.  5. 10 
as  functions  of  the  pulse  duration  (a)  expressed  as  a  multiple  of  the 
time  constant  (j).  It  may  he  noted  from  these  curves  that  the  rectangular 
shaped  input  pulse  (type  "a")  results  In  the  greatest  energy  transfer 
through  the  channel  for  all  hut  very  long  pulse  durations  (longer  than 
five  time  constants). 

5*3*3*2  ti  for  the  Vfcveforms  Considered  In  Section  5. 3.2.2 

-  .  -  -  -  --J  --  -  .  .  . —  -  t  -  - 

de  values  of  for  the  two  types  of  waveforms  considered  under 

a)  and  h)  of  section  5*3*2. 2,  for  the  BLC  low-pass  network,  nay  he 
plotted  as  function  of  the  pulse  duration  similar  to  the  above,  and  the 
graph  in  Tig.  5. 11  results.  It  can  he  seen  that  for  this  network,  the 
rectangular  shaped  Input  pulse  also  results  In  the  greater  energy  trans¬ 
fer  through  the  network. 

5.4  Optimum  Waveshapes  for  Complete  Ulnlnatlom  of  Inter  symbol  Interference 
In  section  5*3>  it  was  seen  that  a  number  of  pulse  shapes  nay  he 
applied  to  a  given  network  so  that  the  output  Is  a  pulse  of  the  same 
duration,  hut  these  Input  pulse  shapes  In  general  differ  in  their  ability 
to  transmit  energy  through  the  network. 

Of  the  many  pulse  shapes  of  specified  duration  which,  when  applied 


98- 


naan  >.ie 


n&mk  5.11 
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to  a  specified  network,  produce  a  pulse  output,  can  one  toe  found  which 

maximizes  n  ? 

P 

5A.1  ***««**»<*  1, 

If  "Method  II"  of  section  9*3*3-  is  used  to  describe  the  input-output 
pulse  pairs  of  specified  duration  associated  with  a  given  network,  then 
Tip  can  be  seen  to  depend  only  on  the  choice  of  the  relatively  unrestricted 
auxiliary  function,  e^t).  The  only  requirements  on  e^(t)  are  that  it 
be  a  pulse  which  has  the  specified  duration,  and  it  aust  be  differentiable 
n  tines,  where  n  is  the  order  of  the  denominator  of  the  network  transfer 
function. 

The  Calculus  of  Tariatlons  can,  therefore,  be  applied  to  find  that 
pulse  shape  for  e^(t)  which  maximizes  r^,  but  with  the  limitation  that 
in  general  only  2 n- times  differentiable  functions  are  admitted  as  possible 
solutions. 

The  expression  for  is 


(5-19) 


I  D  8V  -  V  8D 

Then  the  first  variation  of  r^,  6  — -3L A*  — ^  must  vanish  for 

all  variations  &e^  vanishing  at  t  -  0  and  t  ■  a.  Let  X  *  maximum  value 
of  T)p  ;  then  for  all  such  fie^  ,  the  following  condition  must  hold  for 

the  optimizing  function  e^(t): 
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* 6  S'  [  4t  • 0  •  (5'20) 

Then  the  optimizing  function  e^(t)  must  satisfy  Euler's  equation  of  order 
2n,  in  the  Interval  0  *  t  &  a: 

(>4  -  “*o>  *l(t)  +  [2<ltoV  U‘oh2)  -  <*1  '  “l>l  *i’  (*>  + 

+  . + 

+(-ir1[2(kn_2k„-  "W»>  -  (klr  ">ll»  «1(2°'2)(o  - 

-  »h2)  •1(2n,(t)  -  0,  kj  .  0  for  1  >  m;  (5-21) 

with  the  "boundary  conditions 

e^O)  .  ei(»)  .  .-(0)  -  .{(.) . 1(n'l)(0)  .  •1(n'l)(«)  -  0.  .  . 


Because  "boundary  conditions  are  specified  at  both  end  points,  equation 
(5-21)  is  readily  solved  only  for  simple  cases. 

5. 4. 1.1  BC  Low-pass  Betwork 

For  the  network  of  section  5*3*2 .1,  Euler's  equation  becomes 


ei  •  1)e1  =  o* 

The  solutions  of  this  equation,  satisfying  e^(0) 

l.l  V2  i.i  n,  2 

form  e^(t)  »  c  sin*<(=jy)  t,  where  -y  ■  (— ) 


(5-23) 

e^(a)  ®  0,  are  of  the 
n  *  1,  2,  ... 


The  value  of  n  which  results  in  the  largest  X  Is  clearly  n  ■  1,  so  that 
the  optimum  pulse  transmission  efficiency  in  the  BC  low-pass  case  is 
given  by 
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1+(fe> 

and  the  optima*  waveforms  are: 


(5-24) 


ei(t)  -  e^t)  ♦  «-[(t)  ■  c  [rtsin  j  t  +  ^  eoa  j*  t  ] 


—7  «in(~  +  arctan  ; 


cos  arctan  — 


(5-25) 


eQ(t)  ■  *e^(t)  ■  c<*  sin  j  t.  (5-26) 

Die  optimum  ware  forms  are  shown  In  Fig.  5*12  for  the  case  aA  «  %, 
and  Is  plotted  in  Fig.  5*13>  with  the  results  obtained  In  sections 
5. 3*3*1  shown  as  dotted  lines  for  comparison.  For  small  a  <  ,  this  optimum 
signal  can  he  seen  to  result  In  shout  a  1  db  improvement  over  the  best 
signal  of  section  5*3*2 .1. 

In  this  first-order  case,  the  variational  solution  represents  an 
optimization  over  all  those  functions  e^(t)  whose  first  derivative  exists 
and  is  continuous,  over  the  pulse  duration.  It  therefore  takes  into 
account  all  permissible  functions  e^(t)  except  those  which  contain  abrupt 
changes  of  slope  for  0  -  t  &  a.  That  no  function  of  the  latter  type  can  be 
the  optimum  e^(t)  can  be  surmised  from  the  fact  that  it  could  be  approxi¬ 
mated  arbitrarily  closely  by  a  function  with  continuous  derivative,  while 
the  above  solution  has  no  suggestion  of  corners  in  the  interval  0-£  t  ^  a. 

5. 4. 1.2  HLC  Low-pass  network 

If  the  variational  method  is  applied  to  the  network  considered  in 
section  5*3*2 .2,  the  Xuler  differential  equation  becomes: 
e£'  "(t)  +  4*4(l-k)  ei(t)  -  0  . 


(5-27) 
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The  following  results  are  obtained,  which  are  plotted  in  Figs.  5 -l1* 
and  3-15: 


(5-28) 


«1(t)  -  c  -^[2*?-(^p)2]cos  ^‘P(t-  |)  -  9*46  |  sin  -^p(t-  |)  + 

.133[2«i2-(^P)2]  cosh  ^P(t-  |)  +  1.26  |  sinh  ^(t-  §)  j  (5-29) 

eQ(t)  ■  c(2<*2)  [cos  ^‘P(t-  ^)  +  .133  cosh  -^p(t-  j)]  (5-30) 

Fig.  5*15  &lso  shews  the  results  obtained  in  section  5*3*3*2  as  dotted 
lines  for  comparison.  It  can  he  seen  that  for  small  a* ,  the  optimum 
signal  (Eq.  5-29)  results  in  an  improvement  of  about  2.5  db  over  the 
3-step  signal  of  section  5*3*2 .2. 

The  above  solution  represents  an  optimization  over  the  restricted 
class  of  pulse  waveforms  e^(t)  which  are  four  times  differentiable  in 
the  range  0  z  t  <•  a. 

5.4.2  Bandpass  Channels 

Although  only  low-pass  networks  have  been  considered  up  until  now, 
the  above  results  may  be  generalized  to  bandpass  equivalents  if  the 
"high-Q  assumption"  is  valid,  that  is,  if  the  response  of  the  bandpass 
network  is  effectively  zero  at  zero  frequency.  In  that  case,  the  optimum 
pulse  waveforms  are  modulated  carriers,  with  the  carrier  frequency  equal 
to  the  center- frequency  of  the  network  and  the  envelope  equal  to  the 
pulse  shape  as  obtained  for  the  equivalent  low-pass  case. 


naum  5.15 
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5.5  Comparison  with  Simple  Rectangular  Pulse  Transmission 

The  complete  cancellation  of  intersymbol  Interference  has  of  coarse 
been  achieved  at  the  expense  of  a  reduction  in  received  energy  for  a 
fixed  transmitted  energy  (per  pulse).  For  Instance,  it  can  easily  be 
verified,  that  the  gated  sine  wave  signal  in  section  5»^*1*1  results  in 
a  smaller  received  energy  than  would  a  rectangular  pulse  of  equal  duration 
applied  to  the  sane  channel,  given  a  fixed  transmitted  energy.  But  full 
use  of  the  energy  of  the  rectangular  pulse  can  only  be  realized  If  a 
single  pulse  is  to  be  transmitted,  so  that  the  receiver  may  observe  the 
exponentially  decaying  transient  over  a  suitable  length  of  time  (which 
depends  on  the  channel  time  constant)— i.e.,  no  chance  for  Intersymbol 
interference . 

Thus  It  is  clear  that  a  meaningful  comparison  must  include  a  con¬ 
sideration  of  Intersymbol  interference  and  transmission  rate.  For  this 
purpose,  a  "conventional"  transmission  consisting  of  rectangular  pulses 
is  appled  to  the  RC  low-pass  channel,  and  the  performance  of  this 
system  is  compared  with  the  one  in  section  5«^*1*1* 

5.5.1  Simple  Rectangular  Pulse  Bystem 

Let  the  transmitted  signal  element  of  duration  a  consist  of  a 
rectangular  pulse  of  duration  d,  where  df  a.  This  signal  element  and  its 
opposite  polarity  counterpart  comprise  the  binary  signal  alphabet .  The 
duration  d  is  fixed  but  not  initially  specified,  in  order  to  permit  some 
control  over  the  intersynibol  interference  by  selection  of  a  suitable  value 
for  d.  Channel  input  end  output  waveforms  for  a  typical  transmission 
of  this  type  are  shown  in  Fig.  5.l£: 
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SIMPLE  HBCTAIOULAR  PULSE  SYSTEM 
FIOUBE  5.16 

It  can  be  seen  that  It  aay  he  desirable  to  sake  d  smaller  than  a,  in 
order  to  reduce  the  intersymbol  Interference.  An  expression  for  this 
interference  will  now  be  obtained. 

First  it  is  necessary  to  give  a  quantitative  definition  for  the 
lntersynbol  interference.  As  previously  stated,  the  waveform  observer 
is  assumed  to  be  a  matched  filter.  Its  output  after  every  received 
signal  element,  and  in  the  absence  of  interference  of  any  kind,  is  one  of 
two  possible  voltage  levels  of  equal  magnitude  and  opposite  polarity.  iy 
intersymbol  Interference  will  be  understood  the  fractional  contribution 
to  this  voltage  level,  due  to  signal  energy  transmitted  prior  to  the 
particular  signal  element  Intended  to  be  indicated  by  this  voltage. 

The  Intersymbol  Interference  experienced  by  any  received  element 
aay  thus  depend  on  the  polarities  of  several  preceding  signal  elements. 

In  the  computations  which  follow,  the  maximal  intersymbol  interference, 


denoted  by  X^,  will  always  be  considered;  l.e.,  the  Interference  which  — 
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for  the  system  being  considered  —  arises  from  a  string  of  equal  polarity 
pulses. 

the  energy  received  in  the  Interval  0  <  t  <  a,  due  to  a  signal 
element  transmitted  during  0<t<a,  1b:  (assuming  pulse  amplitude  «  1 
at  channel  input) 

B01  .f  (i-."0*)2  at  .f  [(!-€-“)  e-a(‘-a)]2  at 


*  d 


ad 


+  1)  € 


-2aa 


(5-31) 


The  value  of  the  output  voltage  at  t  •  0,  due  to  a  single  transmitted 
pulse  initiated  at  t  *  -a,  is  eQ(0)  -  (e0^  -  ljc-0*.  After  another 
element  length  this  voltage  decays  to  eQ(a)  =  (e0^  -  l)  €  ^ota;  etc.  The 
main  mum  possible  interfering  waveform,  in  the  interval  0<£t<a,  due  to 
a  string  of  equal-polarity  input  pulses  preceding  t  =  0  is  therefore 


«x(t)  -  (c04  -1)  ( 


n«l 


c-at 

-aa 


l-€ 


0<t<a. 


(5-32) 


Contribution  by  thiB  interference  to  the  output  of  the  matched  filter  is 
a 


E  *=  /  e  (t)  e  (t)  dt 
ox  J  Ox  '  Xx  ' 


(€^-1)  r 


1-  € 


-aa 


J  (i-  at  .  f  (l-  .^a). 


-a(t-d)  -at 


o  ea(a"d).  g"0* 


2a 


l-e 


-aa 


(5-33) 
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The  inter symbol  interference  is  therefore 

Ib  "  *ol  "  t2ad+2s'a^-2-e^(0)]  (l-e"0*)  ' 


(5-3*0 


Ajb  in  earlier  sections,  it  is  again  convenient  to  normalize  with  respect 
to  a  and  thus  to  oahe  ea  one  variable  in  the  above  equation,  while  d  can 
be  written  as  a  fraction  of  a. 

The  solid  curves  in  Tig.  5*17  are  contours  of  constant  plotted 
in  the  act,  —  plane.  Scsw  incidental  facts  about  the  rectangular  pulse 

o 

system  may  be  noted.  It  can  be  seen  that  as  aac  decreases,  I  increases 

U 

rapidly.  Fbr  small  values  of  act,  changing  d  has  .Little  effect  on  the 
mirimm  intersymbol  Interference.  However,  for  any  given  value  of  act 
(given  channel  time  constant  and  transmission  rate),  I  is  always  mini- 

J& 

mlzed  by  making  d  «  0.  Unfortunately,  this  means  no  transmission. 

The  pulse  transmission  efficiency  of  the  rectangular  pulse  system, 
Hr(d),  is  given  by  the  expression 


nr(d) 


*ol<d> 
~d  * 


(5-35) 


This  may  be  compared  with  n  for  the  transmission  system  in  section  5. 4. 1.1. 

5.5.2  Comparison  of  the  transmission  of  Section  5. 4. 1.1  with  that  of 
Section  5.5.1 

An  RC  low-pass  channel  with  a  certain  time  constant  —  is  assumed 
given,  and  it  is  desired  to  transmit  at  a  certain  rate  7  through  this 
channel;  l.e.,  act  is  assumed  specified.  In  addition  it  is  specified 
that  the  Intersymbol  interference  may  not  exceed  a  certain  value. 

Two  types  of  transmissions  are  considered  for  use  in  this  situation, 
the  gated  sinusoid  transmission  of  section  5. 4. 1.1  and  the  rectangular 
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pulse  transmission  of  the  previous  section,  the  latter  with  arbitrary 
value  for  d,  d^a.  Por  the  specified  conditions,  how  do  the  pulse  trans¬ 
mission  efficiencies  for  the  two  types  of  signals  compare? 

It  is  merely  necessary  to  consider  the  ratio  -  ■  11  .  If  this  ratio 


is  greater  than  1,  the  rectangular  pulse  transmission  is  more  efficient; 
if  it  is  less  than  1,  the  gated  sinusoid  transmission  is  more  efficient. 
Contours  of  constant  values  for  this  ratio  are  shown  as  dashed  lines 

nr 

in  Pig.  5*17*  To  the  left  of  the  contour  —  =  1,  the  rectangular  pulse 

nP 

transmission  is  more  efficient.  Note  'chat  this  is  possible  only  if  about 

kf  maxi  mum  intersymbol  interference,  or  more,  is  permitted.  Thus,  if  the 

allowable  maximum  inter  symbol  interference  is  greater  than  about  end 

also  is  such  that  it  can  be  satisfied  by  the  rectangular  pulse  transmission 

for  a  specified  value  of  a a,  then  d  can  he  adjusted  to  make  the  rectangular 

pulse  transmission  more  efficient.  For  instance,  if  aa  *  1.8  and  I  =  hoi 

m 

maximum  are  specified,  then  transmission  of  rectangles  of  duration  |  a  is 
50^  more  efficient  than  the  gated  sinusoid  transmission. 

What  happens  as  “  —  the  product  of  transmission  rate  and  time 
constant  —  is  to  be  increased,  while  the  maximum  tolerated  I  is  held 
constant,  can  be  seen  by  sliding  along  the  appropriate  Im  contour  in 
Fig.  or  by  referring  to  Fig.  5*^8,  where  1^  is  read  along  the 

vertical  axis.  Let  the  specified  maximum  intersymbol  interference  be  10$. 
The  performance  of  the  rectangular  pulse  system  can  be  seen  to  be  as 
follows : 


act  >6.5:  I  <  0.1  always,  for  d<a  (greatest  efficiency  is 

achieved  with  d  slightly  less  than  a;  ti^tj  slightly). 
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CONTOURS  OP  CONSTANT  nr/  FOR  THE  PERFORMANCE  COMPARISON 

nP 

IN  SECTION  5*5 


FIGURE  5.18 
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6.2<c  aa<6.5:  I  <0.1  by  suitable  selection  of  c);  n  slightly  less 
m  r 

than  ti 

P 

3.0<ea<6.5:  I  -  0.1  and  n  >  ti  by  suitable  selection  of  d 
m  'r  p 

2.k  aa<3.0:  I  ^  0.1  but  t\  <ctj  for  all  allowable  d 
m  r  p 

aa  < 2.k:  I  exceeds  0.1 
m 

5*5^3  Suimnary  of  Comparison 

In  suimnary  the  following  conclusions  may  be  drawn  from  the  above 
comparison.  Consider  a  fixed  channel  time  constant: 

1.  If  the  time  allotted  to  one  signal  element  is  sufficiently 
long  (compared  to  the  channel  time  constant),  the  gated  sinusoid  signal 
is  very  slightly  superior  to  the  rectangular  pulce  signal. 

2 .  There  is  a  range  of  element  durations  in  which  the  rectangular 
pulse  transfers  more  energy  through  the  channel  than  does  the  gated 
sinusoid,  and  yet  does  not  produce  excessive  intersymbol  interference. 

For  instance,  if  no  more  than  10$  maximum  intersymbol  interference  is 
tolerated,  this  range  is  about  2:1,  corresponding  to  3*0  <oa<  6.2 . 

3.  For  short  durations  (high  transmission  rate)  the  gated  sinusoid 
transmission  becomes  much  less  efficient  than  the  rectangular  pulse  trans¬ 
mission,  but  the  latter  results  in  very  large  intersymbol  interference. 

In  other  words,  as  the  transmission  rate  is  increased,  the  intersymbol 
interference  produced  by  the  rectangular  pulse  system  increases,  and  it 
takes  an  increasing  fraction  of  the  transmitted  energy  to  achieve  elimina¬ 
tion  of  the  intersymbol  interference. 

5.6  Sensitivity  of  the  Optimum  Performance  to  Changes  in  Channel  Parameters 
After  the  optimum  input  pulse  -  one  which  maximizes  the  energy  trans¬ 
fer  through  the  given  channel  -  has  been  found,  it  is  of  interest  to  determine 
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the  effect  of  slight  changes  in  the  channel  characteristics.  In  such  a 
case,  the  output  Is  generally  no  longer  a  pulse,  and  consideration  oust 
he  given  to  the  energy  received  during  the  intended  pulse  duration,  as 
veil  as  the  energy  received  thereafter  due  to  the  remaining  transient,  the 
sum  of  the  tvo  being  the  total  received  energy  for  t>0. 

A  change  In  the  channel  parameters  (or  their  inaccurate  determination) 
thus  affects  system  performance  not  only  by  a  change  in  the  received  energy, 
but  also  by  the  introduction  of  Intersymbol  interference  which  had  been 
thought  eliminated.  Besides,  the  received  waveform  also  changes,  so  that 
the  "waveform  observer"  would  have  to  be  matched  to  a  new  waveform  in 
order  to  utilize  fully  the  received  energy.  This  latter  problem  is  not 
considered  in  tills  section,  but  the  received  energies  have  been  computed 
for  a  particular  case. 

5.6.1  The  Pulse  of  Section  5. 4. 1.1  Transmitted  Through  an  Arbitrary  !tC 
Low- pass  network 

In  section  5 -^-l-l  the  input  pulse  waveform  of  specified  duration  was 
found  which  effects  the  most  efficient  energy  transfer  through  an  RC  low- 
pass  network  of  time  constant  and  results  in  a  pulse  at  the  output.  If 
this  input  waveform  Is  applied  to  an  RC  low-pass  network  with  time  constant 
j  ,  then  the  following  observations  can  be  made: 

a)  The  output  waveform  is  a  pulse  only  if  o  ■  7.  (Pig.  5*19) 

b)  For  a  given  transmitted  energy  the  energy  received  during  the 
interval  0^  t <a  increases  with  7,  but  for  7  >  a  it  is  less  than 
it  would  be  if  the  transmission  were  optimized  for  7  ,  whereas 
for  7<a  it  is  greater  than  what  it  would  be  if  the  transmission 
were  optimized  for  7.  (Pig.  5*20) 
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c)  For  0.56  £<2.6,  approximately,  the  energy  received  after  the 
tine  interval  (o,  a)  is  always  less  than  10 ^  of  the  energy  re¬ 
ceived  during  (o,  a).  For  0.86  £<1.3,  approximately,  the 
energy  received  after  the  time  interval  (o,  a)  is  always  less 
than  ljt  of  the  energy  received  during  this  interval.  (Fig.  5*21) 
More  detailed  Information  may  he  taken  from  the  accompanying  graphs 
which  give  the  results  of  the  computations  performed.  It  may  he  con¬ 
cluded  that  the  performance  of  the  system  of  section  5 *4.1.1  is  not  very 
sensitive  to  small  changes  in  channel  time  constant. 

5.7  Transmission  of  Overlapping  Pulses 

In  this  section,  a  mode  of  pulse  transmission  is  considered  which 
differs  from  the  one  implied  in  the  discussion  up  till  now.  It  will  be 
shown  that  a  further  improvement  over  the  optimum  transmission  of  section 
5.4  is  possible. 

So  far,  it  has  been  assumed  that  signal  energy  which  is  transmitted 
during  the  interval  (o,  a)  but  received  after  time  t  =  a  causes  inter¬ 
symbol  interference,  i.e.,  the  next  signaling  element  is  transmitted  and 
received  in  the  Interval  (a,  2a).  Instead,  pulses  are  now  transmitted 
so  that  their  durations  partially  overlap,  the  region  of  overlap  being 
specified.  The  receiver  is  assumed  to  make  no  observations  during  the 
interval  of  overlap. 

The  same  kind  of  channel  is  assumed  as  has  been  considered  in  previous 
sections . 

In  order  to  make  the  results  obtained  here  commensurate  with  those 
of  the  earlier  sections,  the  transmission  rate,  ~  ,  should  remain  the 
same;  i.e.,  new  pulses  are  initiated  every  a  seconds.  The  pulse  duration 
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is,  therefore,  taken  to  he  a  +  h,  where  h  is  the  interval  of  overlap, 
as  indicated  in  Tig.  5.22. 


PULSE  TRABSMISSIOH  WITH  OVERLAP 
FIGURE  5.22 

Since  the  waveform  observer  is  only  operating  during  the  interval 
(b,  a),  the  performance  criterion  becomes  the  ratio 

/.  \  received  energy  during  the  interval  (b»  a) 

^p'  '  *  average  transmitted  energy  per  pulse 

Because  the  waveforms  also  overlap  at  the  transmitter,  the  denominator 
of  the  above  expression  requires  some  additional  assumptions .  Let  it 
be  assumed  that  successive  transmitted  pulses  are  selected  independently 
with  equal  probability  from  an  antipodal  binary  waveform  alphabet.  In 
that  case, 


-118- 


„p0>)  - 


L  eo(t>  at 


J  e^(t)dt  +±f  [e1(t)  +  e1(t-a)]2dt+  \  J  [e^tj-e^t-a)]2 


dt 


r  dt 

«  Jjl _ 

r  e2(t)  dt 
Jo 

5.7.1  Pie  Pulse  of  Section  5. 4. 1.1  Transmitted  vitfa  Overlap 

As  a  specific  example,  the  optimum  system  of  section  $.k.  1.1  will 
now  "be  called  upon  to  transmit  at  some  rate  —  with  some  overlap  h, 
Oib<a.  Is  it  possible  to  achieve  an  improvement  over  the  performance 
obtained  in  section  5«^.1«1? 

For  this  system. 


(5-37) 


ipCb)  = 


(a2-b2)+  j  (a+b)2  sin 
(a+b)2  +  7 


2xb 

a+b 


(5-38) 


A  plot  of  this  expression,  for  different  values  of  a a,  is  given  in  Fig.  5-23 
said  indicates  that  a  non-zero  value  for  b  can  improve  the  energy  transfer 
through  the  system,  in  spite  of  the  fact  that  same  of  the  received  energy 
is  deliberately  discarded. 

This  shows  that  further  optimization  of  the  transmitted  signal  is 
possible  (beyond  the  optimum  obtained  in  section  5**0  while  still  avoid¬ 
ing  intersymbol  interference. 

5.8  Conclusions 


The  investigation  reported  in  this  chapter  shows  that  definite 
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improvement  c  can  be  achieved  in  the  performance  of  a  canaminl cation 
system  by  giving  suitable  consideration  to  the  design  of  signals.  An 
alternate  benefit  to  be  derived  from  an  application  of  signal  design 
would  be  the  easing  of  coding  requirements  while  maintaining  the  same 
system  performance. 

Optimum  pulse  signals  have  been  found  for  non- overlapping  trans¬ 
mission  which  satisfy  the  requirment  of  zero  intersymbol  interference  at 
the  receiver.  This  optimization  has  been  made  for  arbitrary  signaling 
rates.  Die  signals  obtained  in  this  manner  for  a  given  channel  can  be 
used  for  transmission  at  rates  that  are  sufficiently  high  to  prohibit  the 
use  of  simple  rectangular  pulses  because  these  cause  excessive  smearing 
of  the  received  waveforms. 

It  has  been  shown  that  for  a  simple  channel  model  the  performance 
obtained  with  signals  that  are  optimized  for  this  channel  does  not 
degrade  rapidly  with  changes  in  the  channel  characteristics.  This  is 
of  particular  interest  in  establishing  requirements  for  channel  identi¬ 
fication  measurements. 

Finally  it  has  been  shown  that  further  performance  improvement 
is  possible  by  permitting  successive  transmitted  waveforms  to  overlap 
somewhat. 

Only  very  specific  cases  have  been  examined  in  seme  detail  in  this 
preliminary  study.  Eowever,  the  results  obtained  give  some  insight  into 
the  properties  and  behavior  of  signals  in  digital  c oraniuni cations .  They 
also  point  out  the  need  for  much  more  work  in  this  area.  More  theory 
must  be  developed  to  treat  the  problem  of  signals  design,  while  the 
results  to  be  obtained  are  almost  certain  to  greatly  benefit  the  com¬ 


munications  art. 


121' 


Further  investigations  should  specifically  be  concerned  with  the 
following  topics: 

1)  Continuation  of  the  work  presented  in  this  chapter,  that  is, 
the  optimization  of  transmission  for  the  system  model  as  des¬ 
cribed  in  section  5 .2. 3. 

2)  The  application  of  other  performance  criteria,  such  as  given 
in  section  5 *2 .2 .2,  suitably  related  to  practical  system  re¬ 
quirements  . 

3)  Consideration  of  models  for  more  general  types  of  channels,  as 
listed  in  section  5.2 .2.1,  which  also  includes  the  problem  of 
specifying  appropriate  channel  models  on  the  basis  of  specified 
practical  system  parameters. 


CHAPTER  VI 


PERFORMANCE  OF  ERROR  CORRECTING  CODES 


6  * 1  Introduction 

An  important  method  of  increasing  the  reliability  of  digital  data 
transmission  systems  is  the  coding  of  the  information  to  be  transmitted 
in  such  a  manner  as  to  enable  the  receiver  to  detect  and  possibly  correct 
the  more  probable  error  patterns  that  the  channel  may  introduce*  A  brief 
heuristic  discussion  of  the  philosophy  of  coding  for  error  reduction 
appears  later  in  this  chapter* 

Many  coding/ decoding  schemes,  of  varying  complexity  and  capabilities, 
have  been  proposed;  it  is  standard  to  express  the  capability  of  a  code  in 
terms  of  the  types  and  magnitudes  of  the  error  patterns  which  that  code 
will  detect,  or  detect  and  correct.  However,  such  expressions  of  capa¬ 
bility  are  useful  in  the  analysis  of  the  "goodness"  of  the  code  only  with 
reference  to  other  codes,  of  similar  complexity;  they  do  not  allow  compari¬ 
son  of  the  performance  of  an  uncoded  channel  to  that  of  a  channel  utilizing 
the  code. 

It  is  the  intention  of  this  chapter,  then,  to  explore  the  relative 
advantages  (principally,  an  increase  in  reliability)  of  coded  versus 
uncoded  systems,  and  the  costs  (in  the  most  general  sense)  of  attaining 
these  advantages.  Although  the  form  of  a  general  solution  valid  for  all 
codes  of  the  type  studied  is  presented,  analytic  and  numerical  results 
are  obtained  only  for  the  more  easily  implemented  codes. 

6.2  Outline 

This  chapter  is  divided  into  several  sections .  A  brief  outline  of 
the  contents  of  each  section  follows. 
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Section  6.3  presents  briefly  a  discussion  of  the  field  of  error  reduc¬ 
tion  coding.  Much  of  the  mathematics  involved  in  the  formulation  of  error 
correcting  and  error  detecting  codes  is  omitted;  however,  sufficient 
detail  is  included  to  enable  the  reader  unfamiliar  with  the  teiminology 
to  follow  the  remainder  of  the  chapter. 

Section  6.4  discusses  the  parameters  involved  in  assessing  the 
quality,  from  performance  standpoint,  of  coding  schemes;  a  measure  of 
code  merit  is  postulated  and  discussed  in  the  last  part  of  this  section. 

Section  6.5  presents  and  discusses  the  restrictions  introduced  upon 
the  systems  to  be  analyzed  in  detail.  There  are:  a  binary  system,  a 
symmetric  memoryless  source  and  a  symmetric  memoryless  channel  disturbed 
by  additive  white  Gaussian  noise. 

In  section  6.6,  a  brief  resume  of  the  relationships  between  channel 
signal-to-noise  ratio  and  the  binit  rate  is  presented. 

Section  6.7  relates  the  channel  probability  of  error  to  the  binit 
probability  of  error  at  the  decoder  output.  The  general  solution  is  a 
variation  of  a  form  found  in  the  literature,  as  is  the  philosophy  of  the 
canqauter  simulation  method  of  solution;  the  analytic  solution  for  the 
Hamming  codes,  however,  is  new. 

The  numerical  results  are  presented  in  detail  in  Section  6.8;  the 
accompanying  text  explains  the  exact  interpretation  of  the  graphs,  and 
includes  examples  of  their  use. 

Mathematical  derivations  in  the  body  of  the  report  are  reduced  to 
a  minimum;  when  these  are  available  In  other  publications,  reference  is 
made  through  the  bibliography.  The  derivation  of  the  Hamming  code  error 
rate  equations  is  new,  and  is  presented  in  detail  in  Appendix  IT.  The 
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results  of  computer  simulation  are  presented  in  Appendix  V.  Tables  of 
coefficients  for  the  Hamming  code  error  rate  equations  are  included  as 
Appendix  VI. 

6.3  Coding  for  Error  Reduction 
6.3.1  Introduction 

It  is  the  intention  of  this  section,  not  to  detail  with  mathematical 
precision  the  various  methods  and  philosophies  of  error  reduction  coding, 
hut  to  present  heuristically,  with  a  minimum  of  such  mathematics,  a  general 
discussion  of  the  field.  For  detailed  or  mathematical  discussions  of 

coding  theory  and  specific  codes,  many  excellent  references  are  available. 

(33) 

ShannonVJJ/  in  his  treatment  of  the  theory  of  communication,  proves 
that  information  may  he  transmitted  over  a  noisy  channel  with  arbitrarily 
low  error  rate  provided  the  rate  at  which  such  information  is  supplied 
to  the  transmitter  is  lower  than  the  chanrel  capacity,  or,  In  other 
words,  providing  that  there  is  room  for  the  insertion  of  redundancy 4 
A  very  simple  example  of  such  redundancy  insertion  is  a  system  that 
transmits  every  binary  digit,  or  "binit  %  three  tiros;  the  observer  (i.e., 
the  decoder)  at  the  receiver  assumes  that  the  actual  transmitted  binits 
all  had  the  same  value  as  that  of  the  largest  number  of  identical  received 
binits.  Such  a  system  interprets  correctly,  then,  any  error  pattern  which 
results  in  either  zero  or  one  error  in  every  block  of  three  binits  corres¬ 
ponding  to  a  single  transmitter  input  binit. 

However,  in  this  example,  three  binits  are  used  to  convey  the  in¬ 
formation  originally  contained  in  one  —  obviously  a  very  high  sacri¬ 
fice  of  channel  capacity.  Bae  search  for  better  codes  may  be  described 
as  &  search  for  efficient  methods  of  introducing  redundancy  into  the 
information  to  be  transmitted. 
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6*3*2  Group  Codes 

This  coding  review  will  deal  with  group  codes  only.  Group  codes 
have  several  interesting  characteristics;  their  main  distinguishing 
feature,  however,  is  the  general  encoding  and  decoding  method.  The 
information  hinits  supplied  to  the  transmitter  are  accepted  in  fixed 
length  blocks.  To  each  such  block  is  adjoined  a  fixed  number  of  check 
binits,  whose  values  axe  determined  by  the  information  binit  values, 
forming  a  code  word.  Similarly,  at  the  receiver,  the  incoming  stream 
of  binits  is  broken  up  again  into  code  words  (note  that  synchronization 
is  required  —  each  received  word  is  a  transmitted  word,  except  for 
binits  changed,  and  thus  in  error,  by  the  noise  in  the  channel ) .  Each 
code  word  is  then  interpreted,  after  the  correction  procedure  is  com¬ 
pleted,  as  a  representation  of  a  particular  block  of  information  binits. 

Another  characteristic  of  group  codes  is  that  the  set  of  all  code 
words  forms  a  vector  space,  where  the  individual  elements  of  each  vector 
(code  word)  are  elements  from  the  modulo  2  field  (in  the  modulo  2  field, 
0+0=0;  0+1=1;  1+1=0)*  Thus,  the  vector  addition  of  any  two 
code  words  is  also  a  code  word. 

6*3*3  The  Decoding  Table 

There  are  many  ways  of  representing  a  particular  group  code;  perhaps 
the  most  straightforward  and  complete,  however,  is  the  decoding  table. 

The  decoding  table  is  a  rectangular  array  of  all  possible  received  words; 
the  code  words  appear  in  the  top  row,  with  the  all-zero  word  (always  a 
member  of  the  set  of  all  code  words)  at  the  top  of  the  first  (left  hand) 
column.  The  remainder  of  the  words  appear  exactly  once  each  in  the  re- 
aminder  of  the  array. 


-126- 


Dxe  rules  for  setting  up  the  array  are  as  follows;  to  form  the  1 
row  (assuming  rows  1,  2.  . ..,  1-1  are  already  formed),  place  any  word, 
not  yet  used  In  any  previous  row  In  the  first  column.  Then,  In  each 
of  the  other  columns,  place  the  word  resulting  from  the  vector  (modulo  2) 
addition  of  this  first  column  entry  and  the  code  word  heading  each  cloumn. 

Consider  the  possibility  of  a  word  appearing  more  than  once  In  the 
table.  Allow  ®  to  represent  vector  (modulo  2)  addition;  set  *  the  word 
In  column  1,  row  1,  with  €j  similarly  defined,  and  1  <  J.  Set  also,  od^  « 
any  code  word,  and  a>2  =  also  any  code  word.  Assume  now,  that  some  word 
appears  twice  in  the  table;  in  particular,  let  the  entry  in  row  1  under 
cd^  =  the  entry  in  row  j  under  o^;  then  ®  <n^  =  •  o>2 . 

Hotice,  now,  that  cd2  ®  o>2=  0,  where  0  represents  the  vector  (word) 
with  all  zero  entries;  also,  o>2  ®  0  =  cd.;  then,  "adding"  to  both  sides 

6i  -  «±«  v  »2 

but,  for  a  group  code,  ox,  ®  <d2*  to^,  some  code  word;  then  »  e^®  cn^ 

i.e.,  e  .  already  appears  In  a  previous  row  (in  particular,  in  the  1th 
J 

row  under  od  ).  Such  a  choice  of  €  .  as  the  first  word  of  the  J  row 
j  J 

would  violate  the  rules  for  forming  the  table.  Thus,  the  situation  of 
Cj®  =  €^®  cd2,  with  1  /  J, 

cannot  occur.  Also,  if  1  =  j,  then  <o^  =  a>_  —  and  this  defines  one  and 
the  same  position  in  the  table. 


The  rows  of,  the  decoding  table  are  normally  given  the  name  cosets  ; 
the  entry  In  the  first  column  In  each  row  Is  termed  the  "coset  leader". 
Note,  now,  that  a  received  word  must  be  either  a  code  word  or  the  "sum" 
(®)  of  a  code  word  and  a  coset  leader.  Thus,  if  the  decoder  is  designed 
to  search  this  table  for  a  given  received  word  and  change  the  received 
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word  to  the  code  word  heading  the  column  in  which  the  received  word  was 
found,  the  decoder  is,  in  effect,  making  the  assumption  that  the  error 
pattern  introduced  in  the  transmitted  word  hy  the  channel  is  the  coset 
leader  for  the  coset  containing  the  word  actually  received.  In  brief, 
the  error  patterns  corrected  by  any  given  code  are  coset  leaders  of  the 
corresponding  decoding  table. 

When,  in  the  formation  of  the  decoding  table,  the  additional  rule 
is  introduced  that  the  word  chosen  for  a  coBet  leader  is  a  word  of  least 
"weight"  (weight  =  number  of  l's)  among  those  yet  to  be  used,  the  table 
is  said  to  be  in  standard  array. 

6. 3 A  Perfect,  Quasi-Perfect  Codes 

A  perfect  t-error  correcting  group  code  is  a  code  that  corrects 
all  patterns  of  t  or  fewer  errors  in  a  code  word,  but  no  others.  A 
quasi-perfect  t-error  correcting  code  is  one  that  corrects  all  patterns 
of  t  or  fewer  errors  and  some  patterns  of  t^l  errors,  but  no  others. 

Equivalent  definitions  would  be  that  perfect  t-error  correcting 
codes  have  as  coset  leaders  all  patterns  of  weight  t  or  less,  and  no 
others,  while  quasi-perfect  codes  have,  in  addition,  some  coset  leaders 
of  weight  t+1. 

6.3*3  Hamming  Codes 

The  basic  Hamming  codes  of  length  n  «  2m  -  1  binits  correct  any 
word  received  containing,  at  most,  one  error;  they  are  perfect  codes 
and,  as  such,  have  all  coset  leaders  (other  than  the  first)  of  weight 
one.  Thus,  an  n  binit  word  length  Hamming  code  has  n  +  1  cosets.  The 
number  of  information  binits  is  k  *  n-m,  leaving  m  check  binits. 

One  particularly  interesting  way  of  encoding  the  message  results 
in  a  simple  decoding  scheme  without  using  a  decoding  table.  Consider 
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the  ordered  'binary  numbers  from  1  to  n,  written  with  m  places 
(i.e.,  i or  m  =  3:  001,  010,  Oil,  100,  101,  110,  111).  Let  the  1th 
number  correspond  to  the  i  hinit  in  the  n-place  code  word*  Notice 
that  there  are  m  hinits  whose  binary  position  representation  contains 
exactly  one  1;  let  these  he  the  m  check  hinits. 

Now  select  all  those  hinits  whose  binary  position  equivalent 
contains  a  1  in  the  "first”  (right  hand)  position  —  namely,  1,  3,  5> 

7,  . ..,  n-2,  and  n;  let  this  he  the  first  "check  sequence".  Similarly 
the  second  check  sequence  is  to  he  made  up  of  those  whose  binary 
equivalents  contains  a  1  in  the  second  position,  and  so  on.  Now  each 
check  sequence  contains,  as  its  first  hinit,  one  of  the  check  hinits, 
and  no  other.  Form  the  code  word,  then,  by  filling  in  arbitrarily  all 
except  the  check  binits;  sum  (modulo  2)  the  value  of  the  hinits  in  each 
check  sequence,  omitting  the  check  hinit,  and  enter  this  sum  as  the 
corresponding  check  hinit.  The  sum  over  any  complete  check  sequence  is 
then  zero. 

Then,  in  decoding,  again  sum  the  hinits  in  each  check  sequence. 
Interpret  each  sum  (modulo  2)  as  the  entry  in  the  corresponding  position 
of  an  m  place  binary  "check"  number.  If  one  error  (i.e.,  a  0  changed 
to  a  1,  or  a  1  to  a  0)  had  occurred  during  transmission,  a  little  investi¬ 
gation  will  show  that  the  resulting  check  number  is  the  binary  position 
equivalent  of  the  hinit  in  error. 

The  basic  SEC  (Single  Error  Correcting)  Hamming  code  may  he  modified 
so  as  to  detect,  without  correction,  all  double  errors  as  well  as  many 
of  higher  order.  Consider  adding  another  check  hinit  to  a  Hamming  SEC 
code  word;  the  value  of  this  hinit  is  1  if  the  weight  of  the  basic  word 


-129- 


is  odd,  and  0  If  the  weight  is  even.  Mow,  for  any  doable  error,  the 

check  word  may  be  non-zero  (thus  locating  the  error)  or  zero  (indicating 

that  it  is  the  overall  check  binit  that  is  in  error). 

6*3*6  Bose-Chandhurl  Codes  36) 

A  full  treatment  of  these  codes  would  not  be  in  keeping  with  the 

intent  of  this  report.  Suffice  it  to  say  that  Bose  and  Chandhuri  have 

devised  a  general  method  for  constructing  codes  capable  of  correcting 

up  to  and  including  t  errors,  t  being  any  positive  integer,  and  that  it 
(37) 

has  been  shown' '  that  two-error  B-C  codes  are  quasi-perfect,  while  B-C 
codes  with  t  3  are  not. 

6.4  Characteristics  of  Code  Performance 

The  characteristics  of  performance  referred  to  are  not  those  tech¬ 
nical  details  associated  with  the  coding-decoding  processes;  these 
details  are  characteristics  of  the  code  itself  and,  although  they  indicate 
in  a  general  sense  the  correction  capabilities  of  the  code,  they  cannot 
be  used  as  measures  of  merit  or  performance.  What  is  meant  by  the  code 
performance  characteristics  are  the  overall  measures  of  the  advantages 
gained  by  the  use  of  the  code,  the  cost  of  attaining  these  advantages, 
and  the  merit  of  the  code.  (A  measure  of  merit  is  defined  below.) 

6.4.1  Costs 

6. 4. 1.1  Complexity 

Associated  with  any  code  are  the  mathematical  manipulations  re¬ 
quired  to  code  the  input  information,  and  to  correct,  as  applicable,  and 
decode  the  coded  messages  at  the  receiver.  Generally,  the  coding  schemes 
may  be  implemented  with  relative  ease;  the  decoding/correction  methods, 
however,  range  from  the  relatively  simple  to  the  extremely  complex. 
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6. 4. 1.2  Information  Bate  Reduction 

The  information  contained  in  a  received  sequence  of  Independent 
digits  is  a  function  of  the  a-priorl  transmitter  probabilities  for  the 
digit  values  and  the  probability  of  an  error  being  introduced  during 
transmission.  It  may  appear  that,  for  fixed  a-priori  probabilities  for 
the  information  digits,  a  code  designed  to  reduce  the  probability  of  error 
would  result  in  an  increase  in  the  information  rate;  however,  for  a  fixed 
digit  transmission  rate,  this  increase  is,  for  the  low  initial  error 
probability  case  of  interest,  negligible  compared  to  the  reduction  in  the 
rate  caused  by  the  code  redundancy.  Thus,  for  the  fixed  bandwidth  (or 
constant  transmitter  rate)  case,  the  net  change  in  the  information  rate 
is  a  decrease,  and  must  be  considered  as  a  cost. 

6. *1.1.3  Omissions 

This  cost  arises  only  when  error-detecting  codes  are  used  with  one¬ 
way  channels.  In  such  a  situation,  a  message  received  in  error  may  be 
assumed  to  fall  into  one  of  three  categories;  the  error  pattern  is  either 
one  which  the  code  is  designed  to  correct,  one  which  the  code  is  designed 
to  detect  without  correction,  or  one  which  is  beyond  both  the  correction 
and  detection  abilities  of  the  code.  In  this  latter  case,  the  pattern 
will  normally  be  interpreted  incorrectly  by  the  decoder  as  being  a  differ¬ 
ent  correction  or  detection-without-correction  error  pattern.  Thus,  insofar 
as  the  decoder  is  concerned,  all  received  patterns  are  either  correctable, 
or  non- correctable.  Although  the  action  to  be  taken  by  the  decoder 
upon  the  detection  of  a  non-correctable  error  pattern  is  part  of  the 
decoding  procedure,  those  actions  will  have  significant  effects  on  code 
performance.  In  the  analysis  to  follow,  it  is  assumed  that  those  re- 
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ceived  words  containing  detectable  but  non- correctable  high  order  error 
patterns  will  be  discarded;  the  resulting  probability  of  an  information 
binit  being  discarded,  or  the  omission  rate,  is  investigated  in  detail 
in  this  chapter. 

6. 4. 1.4  Delay 

The  decoding  of  any  group  code  requires  that  the  complete  code  word 
be  available;  thus,  there  can  be  no  output  from  the  decoder  until  the 
entire  word  is  received.  Except  in  special  situations,  this  delay  is  too 
short  to  be  of  significance  in  the  evaluation  of  code  performance. 

6.4.2  Advantages 
6.4.2 .1  Beliability 

Ignoring  the  insignificant  increase  in  information  rate  resulting 
from  a  reduced  probability  of  error  (as  discussed  in  6. 4. 1.2),  decreasing 
the  probability  of  error  for  the  received  information  binits  at  the 
decoder  output,  and  thus  increasing  the  reliability  to  be  placed  in 
the  received  data,  is  the  only  reason  coding  would  be  used. 

6.4.3  Measure  of  Merit 

In  general,  under  the  constraint  of  fixed  energy/binit  and  fixed 
binit  transmission  rate,  coding  will  buy  an  increase  in  reliability  at  the 
price  of  a  reduction  in  information  rate.  Having  two  parameters  of  per¬ 
formance  for  each  code  makes  comparisons  of  the  value  of  different  coding 
schemes  difficult. 

Another  system  eliminating  this  difficulty  may  be  postulated.  Con¬ 
sider  the  application  of  coding  to  a  channel  for  which  the  average  power 
and  the  maximum  allowable  error  rate  are  specified  as  design  require¬ 
ments  .  The  error  rate  required  then  may  be  used  to  calculate  the  re¬ 
quired  ratio  of  the  energy  per  binit  to  the  noise  spectral  density. 


-132- 


E/»o,  for  coded  as  well  as  uncoded  systems.  From  these  ratios  and  the 
fixed  average  power  limitation,  a  maximum  rate  of  information  hinit 
transmission,  relative  to  that  for  the  uncoded  Bystem,  may  he  obtained. 
Such  a  quantity  is  well  suited  for  use  as  a  criterion  of  comparison  among 
different  coded,  as  well  as  uncoded,  systems;  it  yields  directly  the 
changes  in  the  rate  of  transmission  of  information  hlnits  resulting  from 
the  use  of  error  correcting  codes. 

It  should  he  remembered  that  for  the  small  error  probabilities  of 
interest,  the  information  binit  transmission  rate  is  very  nearly  the 
information  transmission  rate  of  the  system.  Thus,  another  proposed 
criterion,  the  ratio  of  information  rate  to  bandwidth,  is  a  function 
of  the  number  of  redundant  binits  per  code  word  only;  these  values  are 
supplied  in  tabular  form. 

6.5  Restrictions  Introduced 

As  is  implied  in  the  chapter  title  and  in  the  preceding  discussions, 
the  major  restriction  imposed  is  that  of  a  binary  system.  In  addition, 
the  following  restrictive  assumptions  are  made. 

6.5.1  Symmetric  Memoryless  Source 

It  is  assumed  that  the  information  to  be  transmitted  has  already 
been  coded  for  maximum  content  per  binit;  this  Infers  that  the  source 
emits  a  series  of  independent  blnits,  each  of  whose  two  values  (usually 
0  and  l)  are  equally  probable. 

6.5.2  Symmetric  Memoryless  Channel 

The  most  efficient  modulation  system  is  the  phase-reversal  keyed; 
for  such  a  system,  the  transmission  of  a  0  or  a  1  requires  an  equal  amount 
of  power,  and  maximum,  transmission  rate  (end  minimum,  average  probability 
of  error)  is  obtained  when  the  receiver  decision  system  is  adjusted  for 
equal  transitional  probabilities,  0- transmitted  to  1-recelved,  and 
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1-transmitted  to  0- received.  A  similar  situation  occurs  vlth  all  symmetric 
modulation  systems. 

Hy  memoryless  channel,  It  Is  Implied  that  there  Is  no  Intersymbol 
interference.  The  solution  for  the  error  rate  of  a  channel  having 
symbol  smearing  Is,  for  all  practical  purposes,  an  unsolved  problem; 
treatment  of  this  situation  Is  beyond  the  Intended  scope  of  this  chapter. 
6.5.3  Additive  White  Gaussian  Boise 

There  are  tvo  main  motivations  behind  the  assumption  of  additive 
Gaussian  channel  perturbance.  The  first  is  a  practical  one,  from  the 
viewpoint  of  analysis;  such  an  assumption  greatly  facilitates  the  analysis 
of  system  behavior.  Greater  Justification,  however,  is  provided  by  con¬ 
sideration  of  the  type  of  system  for  which  error  correcting  codes  hold  the 
greatest  benefits.  As  mentioned  in  6. 4. 1.1,  coders  are  easily  imple¬ 
mented,  can  be  made  light  in  weight,  and  draw  little  power;  decoders, 
however,  can  be  extremely  complex.  One  of  the  most  critical  applications 
of  communication  links,  so  far  as  minimizing  transmitter  weight  and  power 
requirements  while  maintaining  high  information  rates  and  low  error  rates 
are  concerned,  is  transmission  from  space  vehicles  and  satellites  to  ground 
stations.  In  the  discussion  of  channel  characterization  of  Chapter  II,  it 
is  pointed  out  (2.3.8)  that  the  frequencies  of  value  for  space  communi¬ 
cations  lie  above  100  me.  It  is  further  advanced,  in  2 .2.5,  that  the 
majority  of  the  additive  disturbances  in  the  30  to  150  me  range  -  Indeed, 
virtually  all  such  disturbances,  for  frequencies  above  150  me  -  are  in 
fact  Gaussian  in  nature. 

6.6  Reliability  of  Symmetric  Mode  Binary  Modulation  Systems 
6.6.1  Introduction 

The  formulae  and  relationships  quoted  in  this  section  are  derived 
and/or  collated  by  Hancock  and  Sheppard  in  a  previous  report,  "Information 
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Efficiency  of  Binary  Communications  Systems  ”,  Contract  AF  33(6l6)-8283. 
They  are  presented  here  only  in  the  interest  of  providing  an  analytic 
"basis  for  the  graphical  presentation  to  follow. 

6.6.2  PSK/MF  -  Coherent  Detection 

This  system  represents  the  best  possible  binary  system  attainable, 
with  respect  to  probability  of  error.  Hie  graphical  results  to  follow 
sure  based  upon  this  system. 

Hie  filter  output  is  described  by  the  conditional  probabilities 
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where  x  =  filter  output 

E  =  energy  per  binit 

Kq  =  noise  spectral  density  (double- sided) 

For  symmetric  operation,  the  resulting  probability  of  error  is 

1  ■ erf  ( /db  )  ] 


Pe  ~~k 


6.6.3  Summary  of  Other  Systems 
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ASK  -  Coherent  Detection: 
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PSK  -  Synchronous  Detection: 
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FSK/MF  -  Coherent  Detection: 
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FSK/MF  -  Phase  Comparison: 
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6  >7  Performance  of  Binary  EC/ED  Codes 

6.7*1  Introduction 

This  section  is  concerned  specifically  with  the  derivation,  analytically 
and/or  experiiaentally,  of  what  is  termed  the  "error  rate  equation". 
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The  error  rate  equation  is  defined  to  be  the  equation  xor  the  blnit 
probability  of  error  at  the  decoder  output  given,  as  the  independent 
variable,  the  channel  word  or  digit  error  probability. 

It  is  assumed  throughout  that  the  transitional  probabilities  for  the 
channel  are  equal,  and  that  the  probability  of  a  single  error  in  the  channel 
is  independent  of  the  past  history  of  the  channel. 

It  should  be  noted  that  errors  at  the  output  of  the  decoder  no  longer 
occur  independently.  All  simple  error  patterns  received  by  the  decoder 
are  corrected,  while  those  of  higher  order  are  not;  hence,  the  output 
errors  occur  in  bursts. 

6.7.2  General.  Error  Bate  Equation 

In  the  derivation  of  an  error  rate  equation,  the  first  logical  step  is 
to  express  the  decoder  output  error  probability  P^  as  a  suimnation: 


•S-I 

all  input 
error  patterns 


P(arbitrary  infoimation  binit  in  error  at  the 
decoder  output | the  specific  input  error  pattern) 

P(a  specific  input  error  pattern;  (6-15) 


For  a  symmetric  channel  with  independent  errors  and  error  probability  p, 


and  for  group  codes, 

P(specific  input  error  pattern)  =  P*  (l-P^)11-* 


(6-16) 


where 


n  »  word  length 

i  =  number  of  errors  in  the  pattern 


since  each  word  is  decoded  independent  of  the  other  words  received. 


P^  may  also  be  expressed  as 

P^  «  Probability  that  an  arbitrary  information  binit  is  in  error 
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all  info 
binits  in  the 
code  word 


P{an  arbitrarily  chosen  info  binit  *»  a  specific  info 
binit  in  the  code  word) 

P{the  specific  info  binit  in  the  previous  condition  is 


in  error  at  the  decoding  output) 


(6-17) 
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Define  k  *  number  of  information  binits  in  the  code  word.  Arrange  these 
binits  in  a  sequence  so  that  "the  octh  binit ",  reads  as  "the  ath  binit 
in  the  sequence  of  k  information  binits  in  a  code  word",  refers  to  a 
unique  binit. 


thus, 


Now,  P  an  arbitrarily  chosen  info  binit  =  a  specific  info  binit  =  j  (6-l8) 
'  k 

P^  =  5  X  *tthe  atil  in*°  at  the  decoder  output  is  in  error}  (6-19) 


a«l 

Consider  the  set  of  all  binits  in  the  code  word;  with  each  binit 
associate  a  number  dj,  l£dj£n,  so  that  by  referring  to  "the  binit”, 
reference  is  made  to  a  unique  binit  in  the  word. 

Every  information  binit  is  also  in  the  set;  let  da  =  the  code  word 
binit  corresponding  to  the  a^*1  information  binit,  as  previously  defined. 
Then,  k 

is  in  error  at  the  decoder  output) 


P* 

e 
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Define  (e* )  as  the  specific  set  of  binits  in  a  word  in  error  at  the 
o 

decoder  output,  with  l^-j^=if,  i*  =  total  number  of  errors  in  the  word  at  the 
decoder  output.  Then  each  e*  corresponds  to  a  d  in  error. 

Define  (e  )  in  a  similar  manner,  but  for  the  set  of  errors  at  the 
decoder  input  resulting  in  the  set  (Cj)  at  the  output.  Here,  l<-j*i, 
and  i  is  not  generally  the  same  as  i*.  Then,  with  "c"  read  as  '^belongs 
to”  or  "is  included  in", 
k 
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Note,  however,  that  P  tda€(«j))  for  a  givan  (ej).  such  that  either 

dae(ep  and  p(4a€(«j))  -  b  or  <*a  i  (ej)  «d  P{da€(ep  )  =  0. 

Define  N.  =  the  number  of  received  error  patterns  (e.)  containing  i  errors 

1 Ct  J 

each  for  which  dae(ej).  Then 


1  I  £  v.1  <1-p.)°'i 

a=l  i=l 

The  problem  is  now  one  of  determining  the  parameters 
6.7*3  Specific  Solution  Methods 
6.7*3 *1  Computer  Simulation 
Rewrite  Eq,.  (6- 22),  thus 
k 
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Nov,  for  error  correcting  codes,  N^  *  the  number  of  received  error  pattern; 

(e.)  containing  i  errors  for  which  the  associated  d  is  in  error;  then 
kJ 

I 

a=l 

decoder  output  as  a  result  of  all  of  the  i-fold  error  pattern  inputs,  and 
k 

^  ^  N^  is  the  average  number  of  times  an  information  binit  is  in  error 

0=1 

as  a  result  of  all  (^)  i-fold  input  error  patterns;  i.e.,  then, 


if  >10. 


a=l 


—  =  the  probability  that  an  arbitrary  information  binit  is  in 
(^)  error 

given  that  some  i-fold  error  pattern  occurred  at  the  decoder  input 
and 
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probability  of  an  i-fold  error  pattern  input. 
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Returning  to  (6-2  3  )>  ft  method  of  solution  by  computer  simulation  is 

obvious.  Set  up  a  decoder  on  the  computer  and,  with  an  assumed  "transmitted” 

all-zero  code  word,  simulate  all  possible  error  patterns  (by  generating  all 

2n  n  binit  binary  numbers)  and  apply  these  to  the  decoder,  Then  for  each 

value  of  i  ones  (i.e.,  errors)  in  a  code  word,  record  the  total  number  of 

ones  (errors)  in  the  information  binits  at  the  decoder  output  for  all  such 

k 

i-fold  patterns.  This  number  is,  then,  ^ 

a**l 


This  method  of  solution,  although  straightforward,  is  quite  lengthy. 

For  a  code  of  length  n,  the  number  of  error  combinations  that  must  be 
examined  is  2n  --  and  the  method  of  examination  (i.e.,  the  decoding  process) 
can  be  quite  complex.  Analytic  solution,  where  possible,  is  preferred. 
6.7»3>2  Analytic  Approach;  Hamming  SEC  Codes 

Several  simplifications  are  possible  when  dealing  with  Hamming  codes; 
these  arise,  basically,  as  a  result  of  these  codes  being  perfect.  (Although 
this  property  is  not  used  explicitly,  the  results  implied  by  this  property 
are  invaluable). 

The  first  simplifying  property  is  the  relationships  between  the  (e.) 

J 

and  (e*).  For  any  received  error  patterns  (e  ),  the  "corrected"  error 

d  d 

pattern  (e*)  must  fall  into  one  of  three  categories:  it  is  identical  with 

J 

(e  );  it  is  (e  )  with  one  error  deleted;  or,  it  is  (e.)  with  one  error  added, 
d  d  J 

Secondly,  it  is  possible  to  show  (see  Appendix  IV )  that  the  number  of 

error  patterns  (e.)  of  fixed  length  i  for  which  the  corresponding  (el)  is 
u  d 

such  that  (e^)  =  (e^)  with  p  adjoined  p^(ej),  for  some  fixed  p,  is 
independent  of  the  value  of  p  considered;  a  similar  cord ition  exists  for 
all  (e^)  formed  by  deleting  p  from  an  (e^)  of  length  i  (and  here  pc(ej) 
is  implied). 
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It  is  also  proved  In  Appendix  IV  that  the  number  of  (e^)  of  length  1 
for  which  the  associated  (ej)  -  (e ^ )  and  aefej );  for  which  (e^)  ■  (e^) 
with  some  p  /(e^)  adjoined,  and  ac(ej);  and  for  which  (e^)  =  (e^)  with 
seme  (3  deleted  pe(e  )  ,  and  ae(e’);  are  each  Independent  of  the  a 

J  «J 

chosen.  From  these,  it  is  obvious  that  the  are  independent  of  a; 
redefining  A^  «  (6-23)  becomes 

n 

K  ■  I  A1  <«-25) 

1=1 

and 

A^  «  the  number  of  received  error  patterns  (e^)  of  weight  (number  of  errors) 
i  for  which  the  "corrected"  error  patterns  (e^)  contain  some  specific  binit 
chosen  from  the  full  code  word. 

6 «7*3«3  Analytic  Approach;  Hamming  SEC/PED  Codes 

For  these  codes,  the  original  definition  of  P^  must  be  examined.  In 
this  report,  it  is  assumed  that  those  error  patterns  of  order  large  enough 
to  be  detected  but  not  corrected  are  to  result  in  the  entire  word  being 
discarded  —  i.e.,  the  complete  lack  of  reception  is  preferable  to  accept¬ 
ing  as  valid  a  group  of  information  binits  known  to  contain  large  numbers 
of  errors.  With  reasonably  small  channel  error  probabilities,  the  average 
number  of  words  discarded  is  shown  to  be  an  extremely  small  fraction  of  the 
total  received  words,  while  the  multiplicative  increase  in  reliability  is 
of  the  order  of  10  to  100,  compared  to  the  SEC  codes. 

Then,  P^  =  Probability  of  an  arbitrary  information  binit  being  in  error 
after  decoding,  given  that  the  word  in  which  the  binit  was  contained  was 


not  discarded. 


In  Appendix  IV,  the  indicator  y  is  defined  as  having  a  value  1  for 
words  that  are  not  discarded,  and  0  for  those  that  are.  Then 

P^  *  P{ arbitrary  information  binit  in  error  after  decoding  ly  «=  1)  (6-26) 

The  actual  analysis  and  the  resulting  computations  are  simplified  by 
working  with  the  formulation 


p,  P{ arbitrary  information  binit  in  error  after  decoding  and  y  =  ll,  . 

pe  =  - p nrrjj - — - 1^-27 ) 

The  numerator  may  then  he  expanded  as  discussed  previously,  and 


P{  arbitrary  information  binit  in  error  after  decoding  and  y  =  1} 


■t  [si 

i=l  a=l 


n'-i 


(6-28) 


with  n1  =  2m  =  code  word  length  (=  n  +  l)  and  Nia  1  =  the  number  of  received 
error  patterns  of  weight  i  for  which  y  »  1  and  the  associated  d  is  in  error. 

Two  different  conditions  for  discarding  the  received  word  are  studied. 
The  first  of  these,  and  the  more  common,  is  that  the  overall  parity  check  is 
satisfied,  but  the  internal,  checks  are  not  —  this  corresponds  to  the 
number  of  received  errors  being  even,  and  (e*)  £  (e  ).  This  discards  all 

0  j 

double  errors,  as  well  as  most  even  weight  error  patterns. 

The  second  condition  considered  is  that  for  which  the  criterion  of  the 
first  applies  and,  alternatively,  the  condition  that  the  informal  parity 
checks  are  satisfied  while  the  overall  check  is  not.  This  then  detects 
and  discards  many  of  the  odd- weight  error  patterns  as  well;  unfortunately, 
it  also  discards  the  one  weight=l  pattern  for  which  the  error  occurs  in 


the  overall  check  binit. 
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For  a  Hamming  SEC/DED  code  operating  under  the  first  condition  of 
word- discard,  the  errors  patterns  of  Interest  (for  even  i)  are  those  for 
which  (e^)  is  such  that  (ep  =  («j)>  length  *  1,  and  length  =  1-1 
(l-l  corresponding  to  the  i-veight  error  patterns  with  one  of  the  errors 
in  the  overall  check  hinit).  As  previously  discussed,  the  relationships 
required  are  shown  in  Appendix  IV,  to  be  independent  of  the  particular  0t 
under  consideration. 

6.7.4  Summary  of  Hamming  Code  Error  Bate  Equations 

Hie  following  results  are  derived  in  detail  in  Appendix  IV. 

For  the  SEC  codes  of  length  n  =  2m-l, 
n 

Pe  =X  n  Mi  *  iHi  +  <i+l)  V  Pei(l_Pe)n"1> 

1=0 

where  =  number  of  error  patterns  of  weight  i  for  which  (e ^ )  has 

weight  1-1  (i.e.,  deletion  of  some  member  of  (e  )  to  form  (e*)); 

J  0 

=  number  of  error  patterns  of  weight  i  for  which  (e^)  =  (e^ ); 

=  number  of  error  patterns  of  weight  i  for  which  (e j )  has  weight 
(i  +  l)  (i.e.,  adjoining  some  to  (e^)  to  form  (e^). 

Note  that  this  form  preserves  the  physical  meaning  of  the  parameters 
With  Mi,  N^  and  as  defined  above,  the  probability  of  receiving  a  word 
of  error-pattern  weight  i  satisfying  the  conditions  defined  for  is 

J  y.  J 

just  M^IT(l-Pe)  ”  If  the  assumption  is  made  that  the  probability  of 
error  for  a  binit  after  "correction”  is  independent  of  that  binit  being 
an  information  blnit,  then  the  probability  of  an  arbitrary  information 


(6-29) 


binit  being  in  error  is  just 


weight  of  (e.) 


weights 

of  !.•) 


.  F( (e^)  having  the  given  weight)  (6-30) 


The  probability  of  (e^)  having  weight  i  is  Just 

We"'  > 

and  becomes 
n 

i*=o 

--  now,  L  1  =  0  and  Mn+1  «  0,  obviously.  Thus 
n 

p;  •  I  ^  L1  pi(1-pe)°'1+  5  Bip^1-pe>n'lt  TT  "i  ^d-^r1],  (6-32) 


as  before. 

It  is  shown  in  Appendix  IV  that  the  parameters  L,  H  and  N  are  related 
by  the  Iterative  equations, 

M±  =  (n-i+l)H1_1 


Hi  =  f  Li-1 


\  =  (?)  -Ni  -Mi 


(6-33) 


with  initial  values  M  -  L  =  0;  N  *1 

o  o  o 


For  the  SEC/BED  codes  of  length  n*  *=  n+1  *  2m,  operating  under  the  first 


word-discard  conditions  discussed  above, 
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n+1 

p;  =  pt^ir{  I  :  ti»i  +  (1-1)^.,]  p‘  d-pj 


n+l-i 


i*2 
(i  even) 


n 

+  X  j  [(i-2)Mi_1+  (i-lfo,.  +  (1-1)1^  +  ±\  +  lL^  +  (l+l)L± 

i=i 

(i  odd)  pi(l_p  jn+l-ij 


(6-34) 


and  n+l  n 

Ply-1)  [Hi+Hi_i]P^  (1-Pe)n+1"i+^  (6-35) 

i=o  ii 

(i  even)  (i  odd) 

—  the  "physical  interpretation"  analysis,  along  the  lines  of  that  for 

equation  (6-30),  is  obvious* 

The  condition  for  discarding  the  word  in  this  case  is  that  (ep  £  (e^) 
and  i  =  even. 

For  the  second  set  of  word-  discard  conditions, 


n+l 

K  -  PlKlT  {I  n  “V  (i-1)"!-!!  ^a-*«>°+1'1 

i=2 

(i  even) 


+  Z  n  ((i-2 )**!_!+  (±-l)M±+  ±Llml+  (1+1)1^]  P^1_Pe)n  1  1 j  (6-3 6) 

i=i  J 


(i  odd) 

with 

Il+l 

n 

P  (y=l) 

-I 

[h1+  ui_1)p^(i-pe)n+i'i+  y 

tMi-i+Mi+Li-i+Li] 

i=o 

i=i 

(i  even)  (i  odd) 

Pi(l-P  )n+1*i 
e'  e' 


(6-37) 


with  the  conditions  for  discarding  a  word  being  (e^)  £  (e^)  and  1  =  even, 

or  (e')  «  (e.)  and  i  =  odd. 

J  J 

In  all  cases,  for  i<0  or  i>n,  ■  t  -  0. 

6 >8  Results 

This  section  contains  detailed  numerical  analyses  of  the  performance 
of  Hamming  SEC  codes  of  lengths  7,  15,  31,  63,  127,  255  and  5H  binits; 
SEC/DED  codes  of  lengths  8,  1 6,  32 ,  6h,  128,  256  and  512  binits;  and  the 
Bose-Chandhuri  (15*  5)  and  (15,  7)  codes;  in  all  cases,  the  modulation- 
detection  system  used  is  phase-shift  keying  with  matched  filter  reception. 

A  comparison  and  conversion  graph  is  supplied  for  use  with  other  symmetric 
systems .  A  brief  introduction  to  each  subsection,  with  examples  of  the 
use  of  the  graphs,  is  included. 

During  the  compilation  of  results,  it  was  found  that  the  probabilities 
of  error  for  the  SEC/BED  codes  operating  under  the  second  set  of  word- 
discard  conditions  was  only  marginally  better  than  those  for  such  codes 
operating  under  the  first,  more  common  set,  while  the  probability  of  word- 
discard  was  greatly  increased.  Fbr  this  reason,  numerical  results  for  the 
second  set  of  conditions  have  been  omitted. 

6.8.1  Fixed  Bandwidth  Analysis 

The  graphs  included  in  Figs.  6.1  through  6.12  are  based  upon  a  fixed 
bandwidth  restriction  -  i.e.,  the  information  binit  rate  of  the  coded 
system  is  reduced  in  proportion  to  the  redundancy  of  the  code,  maintaining 
a  constant  transmitter  rate. 

Eable  6-1  lists  the  information  binit  rate  of  each  coded  system, 
based  upon  an  uncoded  rate  of  unity.  Fbr  low  error  probability,  this 


rate  is  very  nearly  the  information  rate. 

E_ 

As  an  example,  consider  a  PSK-MF  system  for  which  the  Ratio  Hq 
is  9.5  db.  Die  bandwidth  of  the  channel  is  fixed;  however,  a  reduction 
in  information  binit  transmission  of  is  permitted.  What  decrease  in 
error  probability  is  attainable? 

Flam  Table  6-1,  the  shortest  Hamming  code  that  can  be  used  is  either 
the  (127,  120)  SEC  code,  or,  if  binit  rejections  are  permitted,  the 
(128,  120)  SEC/lED  code.  The  uncoded  error  probability  is  1.4  x  10  ^  ; 
(Fig.  6.3).  With  the  SEC/DED  code,  the  factor  is  52,  reducing  the  error 
rate  to  2 .7  x  10  ^  (Fig.  6.7),  but  this  introduces  information  binit 
rejections  by  the  receiver  with  a  probability  of  1.2  x  10  (Fig.  6.11). 


Code 

Rate 

Code 

Rate 

Hamming  - — - — 

. SEC 

Hamming  ------- 

. sec/ded 

(7,  *0 

0.571 

-*• 

CO 

0,500 

(15,  n) 

0.733 

(16,  11) 

0.683 

(ii,  26) 

0.839 

(32,  36) 

0.808 

(63,  57) 

0.905 

(64,  57) 

0.891 

(127,  120) 

0.945 

(128,  120) 

0.938 

(255,  247) 

0.969 

(256,  247) 

0.965 

Lin,  5.02) 

0.982 

(512,  502) 

0.980 

Bose - Chandhuri 

Codes 

mm 

0.467 

_ (ig.i.,5? 

TABLE  6-1 

MFOIMATIQH  BIHIT  RATE- SIZED  BAHWHHH  STSXEK 
(Ho  Coding  =  l) 


-147- 


6.8.2  Plxed  Infoimation  Blnlt  Bate 

Pigs.  6.I3  through  6.24  provide  a  code  performance  analysis  under 

the  restriction  of  constant  rate  of  information  binit  transmission.  To 

provide  a  criterion  of  comparison,  the  ordinate  of  the  graphs  is  the 
Ef 

ratio  in  db,  where  E'  is  the  energy  per  information  binit  (for  the 

a0 

uncoded  case,  this  is  then  the  energy  per  transmitted  binit). 

In  this  case,  then,  the  actual  energy  per  transmitted  binit  is 
reduced  from  the  graphed  value  in  proportion  to  the  redundancy  of  the  code 
under  consideration. 

Example :  A  PSK-MF  system  is  to  be  used  under  a  transmitted-pover 

V 

restriction  that  results  in  an  uncoded  =-  of  11.0  db.  If  the  inforaa- 

*0 

tion  binit  transmission  rate  is  to  be  maintained,  what  is  the  shortest 

-4 

Hamming  SEC  code  that  will  result  in  an  output  error  probability  of  10  ? 

To  hold  both  the  information  binit  transmission  rate  and  the  average 

power  constant,  the  energy  per  information  binit  must  be  held  fixed 
E1 

-  i.e.,  is  to  remain  at  9*0  db.  Reference  to  figs.  6.13  through  6.16 
o 

shews  that  the  shortest  code  that  satisfies  the  error  rate  requirement 
is  the  (lp,  ll)  code  and  this  results  in  an  error  rate  of  3.5  x  10 

An  interesting  phenamenom  is  emphasized  by  the  constant  information 
binit  rate  graphs  —  that  the  ’*best"  code,  in  terms  of  lowest  probability 
of  error,  is  not  always  either  the  shortest  or  the  longest  code  permis¬ 
sible.  Die  longer  codes  lose  less  power  due  to  redundancy,  but  have 
greater  inherent  error  rates,  while  the  words  of  the  shorter  codes,  al¬ 
though  inherently  less  prone  to  multiple  errors,  sacrifice  much  of  the 
transmitter  power  in  the  check  binit  transmission.  Generally,  then,  at 
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any  fixed  power  level,  constant  information  binit  rate  operation  will 

result  in  an  optimum  code  in  a  particular  set  of  codes. 

In  particular,  for  all  of  the  Hemming  SEC  codes  investigated,  no 

E* 

improvement  at  all  is  possible  below  an  rr-  ratio  of  'J .0  db.  Prom  7.0  db 

*0 

to  10.1  db,  the  (31,  26)  code  results  in  the  lowest  P'  ;  from  10.1  to 

approximately  11.2  db,  the  (63,  57)  code  is  best,  while  from  11.2  db  to 

approximately  15  db,  the  (127,  120)  code  is  optimum.  Prom  15  db  out  to 

the  maxi mum  ratio  studied,  both  the  (255>  247)  and  the  (511,  502)  codes 

give  approximately  equal,  and  lowest  error  probabilities.  A  comparable 

situation  exists  for  the  SEC/BED  codes. 

An  interesting  feature  of  the  SEC/BED  codes  is  that  the  probability 

E 

of  rejection  is  asymptotic  to  0*5  as  the  ratio  drops,  This  is  a 

o 

natural  outcome  of  the  fact  that,  for  high  channel  error  probabilities, 
the  probability  of  a  received  word  containing  at  most  one  error  becomes 
very  small;  for  the  remaining  error  patterns,  all  of  those  with  even 
parity  (neglecting  those  for  which  the  check  word  is  zero)  are  discarded  - 
i*e.,  the  probability  of  rejection  approaches  the  probability  of  an  arbi¬ 
trarily  chosen  set  of  binary  digits  having  even  parity. 

6*8.3  Merit 

The  merit  graphed  in  Figs.  6.25  through  6. 31  is  arrived  at  by  cal- 
E 1 

culating  the  ratio  tt-  required  to  obtain  a  given  error  rate  for  the 

°  E*  E 

coded  system,  and  dividing  this  into  the  corresponding  Y  =  T  for 

o  o 

uncoded  system.  The  resulting  figure  Indicates  l)  the  factor  by  which 
the  transmitted  power  may  be  reduced  (while  maintaining  a  constant  informa 
tion  binit  rate)  by  the  use  of  coding,  or  2)  the  increase  in  information 
binit  rate  attainable  at  a  fixed  average  transmitter  power. 
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Example:  An  uncoded  PSK-MF  system  is  operating  with  an  error  rate 

-4 

of  0.15  x  10  •  With  no  restrictions  on  "bandwidth,  how  much  faster  may 

the  information  he  transmitted,  with  the  same  average  transmitter  power 
and  error  probability,  if  a  Hamming  SEC  code  with  N  *  63  is  used?  If  an 
increase  of  30^  is  desired,  how  much  power  can  be  saved  while  simultan¬ 
eously  achieving  this  increase,  using  this  code? 

Referring  to  Pig*  6.26,  the  merit  of  the  (63,  57)  code  at 
«  0.15  x  10  ^  is  1.40;  thus,  the  information  binit  rate  may  be 
increased  by  this  factor.  If  an  increase  to  I.30  times  the  original 
rate  is  desired,  the  average  power  may  be  reduced  by  lAo/l.30  =  1*08, 
or  0*3  db. 

The  existence  of  an  optimum  length  code  for  a  given  error  probabil- 
E 

ity/uncoded  — •  ratio  range,  when  operating  under  a  fixed  information  binit 
o 

rate  constraint,  as  discussed  in  6.8.2,  is  again  illustrated  by  the  merit 
graphs .  (Recall  that  these  graphs  are  based  upon  either  the  increase  in 
the  information  binit  rate  at  a  constant  average  power,  or,  alternatively, 
the  allowable  power  decrease  at  constant  information  binit  rate.)  More¬ 
over,  these  graphs  expand  this  information,  making  a  more  accurate  de¬ 
termination  of  the  crossover  points  possible.  These  are  listed  in 


Table  6-2. 
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0.12  to  1.4  x  10-2  8 


1.4  x  10'2  to  6.5  x  10_lf 

16 

6.5  x  10"^  to  1.4  x  lO-^ 

32 

1.4  x  10-6  to  10’n 

64 

lO-11  to  2  x  10"19 

128 

2  x  10~^9  to  'below  10~2^ 

256 

TABLE  6-2 

OPTIMUM  CODE  LENGTH  PSK/MF  SYSTEM 

It  should  he  noted  that  the  two  Bose-Chandhuri  codes  analyzed  never, 
in  the  range  for  which  the  merit  exceeds  unity,  out-perform  the  optimum 
Hamming  code;  this  is  a  natural  result  of  the  high  redundancy  of  the 
Bose-Chandhuri  codes. 

Finally,  it  must  he  realized  that  the  increases  in  information  rate 
permitted  hy  coding  are  conditional  upon  the  effects  of  increasing  the 
transmitted  hinit  rate  and  the  system  bandwidth,  other  than  the  resulting 
energy-per-hinit  decrease  already  considered. 


10' 
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REJECTION  RATES:  HAMMING  SEC/DED  CODES  -  FIXED  BANDWIDTH  SYSTEM 

FIGURE  6.12 
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CHAPTER  VII 

SUMMARY  ARU  CONCLUSIONS 

7,1  Introduction 

This  chapter  contains  a  brief  summary  and  recommendations  for  future 
work  in  the  areas  studied. 

7*2  Nonlikelihood  Detection  Theory 

The  canmrunication  engineer  has  been  frequently  faced  in  the  past  with 
the  detection  of  a  signal  in  noise  of  unknown  statistics  and  will  continue 
to  do  so  in  the  future,  with  the  increasing  importance  of  outer  space 
travel  and  of  jamming  of  communications  by  an  enemy.  In  both  of  the  above 
cases,  it  is  most  difficult  to  obtain  these  noise  statistics.  No  detection 
method  presently  available  will  guarantee  the  required  reliability.  The 
theory  of  nonp&rametric  detection  is  the  only  theory  applicable  and 
appropriate  for  these  problems.  Moreover,  nonpar ame trie  detection  theory 
is  complete  in  the  sense  that 

(1)  It  suggests  the  structure  of  the  detection  system  which  in  most 
cases  can  be  implemented  digitally. 

(2)  It  specifies  procedures  for  evaluating  the  performance  of  such 
systems  (probability  of  error,  information  rate,  etc.}. 

(3)  It  specifies  techniques  of  system  comparison. 

The  properties  of  and  results  concerning  nonparametric  detectors 
obtained  thus  far,  were  obtained  under  the  severe  assumption  of  independence 
of  the  observation  samples.  This  independence  is  hard  if  not  impossible  to 
be  guaranteed  since  the  appropriate  sampling  times  that  will  result  in 
independent  samples  are  unknown,  whenever  the  probability  density  and 
spectral  density  of  the  noise  are  unknown.  If  one  attempts  to  hopefully 
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obtain  independent  samples  by  sampling  at  very  long  intervals,  this  would 
decrease  the  information  rate  to  such  an  extent  as  to  render  the  system 
useless  for  the  transmission  of  information. 

It  is,  therefore,  imperative  to  establish  the  validity  or  not  of  the 
results  thus  far  obtained,  for  the  practical  case  of  dependent  samples. 

If  the  results  are  valid  for  dependent  samples,  this  would  guarantee  a 
practical  and  reliable  communication  system  of  high  information  rate  even 
in  the  presence  of  noise  of  unknown  statistics.  Further  extensive  research 
is  required  to  obtain  the  constant  K  for  the  various  nonparametric  (non- 
likelihood)  detectors  and  for  various  actual  or  simulated  channel  conditions 
(tropospheric  scatter,  ionospheric,  line-of-sight  transmission,  etc.). 
Knowledge  of  these  constants  would  permit  the  quick  design  of  a  communi¬ 
cation  system  appropriate  to  a  particular  channel  condition. 

7«3  Optimization  of  Signaling  Waveforms 

The  investigation  reported  shows  that  definite  improvements  can  be 
achieved  in  the  performance  of  a  communication  system  by  giving  suitable 
consideration  to  the  design  of  signals.  An  alternate  benefit  to  be  derived 
from  an  application  of  signal  design  would  be  the  easing  of  coding  require¬ 
ments  while  maintaining  the  same  system  performance. 

Optimum  pulse  signals  have  been  found  for  non- overlapping  transmission 
which  satisfy  the  requirement  of  zero  intersymbol  interference  at  the 
receiver,  ibis  optimization  has  been  made  for  arbitrary  signaling  rates. 

The  signals  obtained  in  this  manner  for  a  given  channel  can  be  used  for 
transmission  at  rates  that  are  sufficiently  high  to  prohibit  the  use  of 
simple  rectangular  pulses  because  these  cause  excessive  smearing  of  the 
received  waveforms. 

It  has  been  shown  that  for  a  single  channel  model  the  performance 
obtained  with  signals  that  are  optimized  for  this  channel  does  not 
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degrade  rapidly  with  changes  in  the  channel  characteristics.  This  is 
of  particular  interest  in  establishing  requirements  for  channel  identi¬ 
fication  measurements. 

Finally  it  has  been  shown  that  further  performance  improvement  is 
possible  by  permitting  successive  transmitted  waveforms  to  overlap 
somewhat . 

Only  very  specific  cases  have  been  examined  in  some  detail  in  this 
preliminary  study.  However,  the  results  obtained  give  some  insight  into 
the  properties  and  behavior  of  signals  in  digital  communications.  They 
also  point  out  the  need  for  much  more  work  in  this  area.  More  theory 
must  be  developed  to  treat  the  problems  of  signals  design,  while  the 
results  to  be  obtained  are  almost  certain  to  greatly  benefit  the  com¬ 
munications  art. 

Further  investigations  should  specifically  be  concerned  with  the 
following  topics: 

(1)  Continuation  of  the  work  presented  in  this  chapter,  that  is, 
the  optimization  of  transmission  for  the  system  model  as  described  in 
section  5*2*3* 

(2)  The  application  of  other  performance  criteria,  such  as  given  in 
section  5 *2. 2. 2,  suitably  related  to  practical  system  requirements. 

(3)  Consideration  of  models  for  more  general  types  of  channels, 
as  listed  in  section  5 *2 .2.1,  which  also  includes  the  problem  of  speci¬ 
fying  appropriate  channel  models  on  the  basis  of  specified  practical 
system  parameters . 

7.1+  Performance  of  Error  Correcting  Codes 

The  results  contained  in  Chapter  VI  cover  only  the  Hamming  SEC 
and  SEC/DED  codes.  Although  these  codes  are  the  most  practical,  Insofar 


-186- 


&b  Implementation  Is  concerned,  there  are  many  other  codes  whose  character¬ 
istics  warrant  further  study.  Of  these,  the  Bose-Chandhurl  t-error  correcting 
codes  are  particularly  Important. 

Another  type  of  group  code  Is  the  hurst-error  correcting  code. 
Unfortunately,  standards  of  comparison  of  performance  for  these  codes  are 
rather  difficult  to  formulate;  and  analysis  of  the  causes  of  hurst  noise, 
the  duration  of  the  noise,  and  Its  effect  on  binary  transmission  channels 
would  he  a  prerequisite  to  a  definitive  analysis  of  a  hurst-error  coded 
channel.  However,  one  application  of  hurst-error  correcting  codes  for  which 
the  basic  channel  disturbance  may  he  as sinned  normal  is  that  where  the  hurst 
code  is  used  in  conjunction  with  the  more  standard  group  codes. 

Consider  a  channel  using  a  (15,  11 )  Hamming  SEC  code,  ftie  Information 
blnits  at  the  decoder  output  are  either  error  free,  or  contain  three  or 
more  errors  in  each  group  of  eleven  derived  from  a  single  transmitted 
word  -  i.e.,  the  errors  introduced  by  the  channel,  including  the  coder/ 
decoder,  occur  in  hursts  of  eleven  or  less  (excluding  the  possibility  of  two 
words  both  being  decoded  in  error  within  a  short  time  period).  Thus,  a 
further  reduction  in  the  error  rate  may  he  obtainable  by  the  encoding  of 
the  original  message  by  a  hurst-error  correcting  code  capable  of  correcting 
bursts  of  length  eleven  or  shorter  -  i.e.,  the  final  system  would  appear  as 
follows : 
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Of  course,  the  Hamming  code  may  he  replaced  hy  a  Bose-Chandhuri 
group  code.  It  is  anticipated  that  such  a  system  would  be  capable  of 
reducing  the  error  rate  to  an  extremely  low  value;  in  fact,  such  a  system 
would  correct  the  high-order  error  patterns  resulting  from  a  complete 
channel  fade,  providing  such  a  fade  did  not  last  longer  than  one  Hamming 
code  word. 

Another  class  of  codes  worthy  of  study  are  the  sequential  codes; 
these  have  the  advantage  of  being,  in  general,  easily  implemented.  Ho 
work,  so  far  as  can  be  determined,  has  yet  been  done  on  assessing  these 
codes. 

Finally,  codes  designed  around  the  use  of  limited  feedback  channels 
have  not  yet  been  analyzed.  Coding  for  such  system  is  quite  different  from 
one  way  channel  coding,  and  is  deserving  of  separate  and  complete  treatment. 

The  field  of  error- correcting  code  design  is  so  new,  and  is  progressing 
at  such  a  rate,  that  very  few  codes  (except  for  the  Hamming  codes  -  in  this 
report)  have  been  analyzed  in  detail.  At  this  stage,  communications 
system  design  problems  relating  to  the  possible  use  of  error  correcting 
codes  cannot,  in  general,  be  answered  by  reference  to  the  existing  literature. 
It  is  hoped  that  further  research  into  code  performance  will  fill  this  void. 


-188- 


LIST  OF  REFERENCES 


1.  BBS  Radio  Propagation  Course,  1962,  Central  Radio  Propagation 
Laboratory,  U.  S.  Department  of  Commerce,  Boulder,  Colorado. 

2.  Hancock,  J.  C.,  An  Introduction  to  the  Principles  of  Communication 
Theory.  McGraw-Hill  Book  Company,  Inc.,  1961,  pp.  186-192. 

3.  Wiesner,  J.  B.,  "Communication  Using  Earth  Satellites,"  Lectures  on 
Communication  System  Theory,  ed.  E.  J.  Baghdady,  McGraw-Hill  Book 
Company,  Inc.,  1961,  pp.  585* 5^7 • 

4.  Rafuse,  R.  P.,  "Characterization  of  Boise  in  Receiving  Systems," 

Lectures  on  Communication  System  Theory,  ed.  E.  J.  Baghdady, 

McGraw-Hill  Book  Company,  Inc.,  1961,  PP •  379” 302. 

5*  Allen,  R.  A.,  "Man-made  Radio  Boise,"  The  Radio  Boise  Spectrum,  ed. 

D.  H.  Menzel,  Harvard  University  Press,  I960,  pp.  1-5. 

6.  Gambling,  L.  B.,  "Lightning  -  Facts  and  Fancies,"  J.  Brit.  IRE. 
vol.  23,  March,  1962,  pp.  I63-I7O. 

7.  Helliwell,  R.  A.,  "Whistler  -  mode  propagation,"  The  Radio  Boise  Spectrum 
ed.  D.  H.  Menzel,  Harvard  University  Press,  i960,  pp.  93-99 • 

8.  Helliwell,  R.  A.,  and  Morgan,  M.  G.,  "Atmospheric  Whistlers,"  Proc.  IRE. 
vol.  47,  Feb.,  1959,  PP-  200-208. 

9-  Crichlow,  W.  C.,  "Determination  of  the  Amplitude-Probability  Distri¬ 
bution  of  Atmospheric  Radio  Boise  From  Statistical  Moments,"  Journ. 
Research  (D.  Radio  Propagation).  BBS  64  D,  Jan.  -  Feb.,  i960,  pp.  49-56. 

10.  Landon,  V.  D.,  "The  Distribution  of  Amplitude  with  Time  in  Fluctuation 
Boise."  Proc.  IRE,  vol.  30,  Sept.,  1942,  pp.  425-429* 

11.  Rice,  S.  0.,  "Properties  of  a  Sine  Wave  Plus  Random  Boise,"  Bell  System 
Technical  Journal,  vol.  27,  Jan.,  1 948,  pp.  109-157- 

12.  Watt,  A.  D.,  and  Maxwell,  E.  L.,  "Measured  Statistical  Characteristics 
of  VLF  Atmospheric  Boise,"  Proc.  IRE,  vol.  40,  Jan.,  1957*  PP-  55_62. 

13.  Montgomery,  G.  F.,  "A  Comparison  of  Amplitude  and  Angle  Modulation  for 
Barrow  Band  Communications  of  Binary-Coded  Messages  in  Fluctuation 
Boise,"  Proc.  IRE,  vol.  4a,  Feb.,  195^,  PP-  447-454. 

14.  Fano,  R.  M.,  Transmission  of  Information,  pp.  I72-I78. 

15.  Sanders,  R.  W.,  "Communication  Efficiency  Comparison  of  Several 
Communication  Systems,"  Proc.  IRE,  vol.  48,  April,  i960. 


-189- 


16.  Capon,  J.,  "Bonparemetric  Methods  for  the  Detection  of  Signals  In 
Boise,"  Technical  Report  Bo.  T-l/B,  Columbia  University,  1959* 

17.  Rice,  S.  C.,  "Mathematical  Analysis  of  Random  Boise,"  Boise  and 
8tochaatlc  Processes,  ed.,  B.  Wax,  Dover  Publications  Inc.,  Bev  York,  195^ - 

18.  Mann,  H.  R.,  and  Whitney,  D.  R.,  "On  a  Test  of  Whether  One  of  Two 
Random  Variables  is  Stochastically  Larger  Than  the  Other,"  Ann.  Math. 

Stat.,  18,  1947,  p.  50* 

19.  Lehmann,  E.  L.,  "Consistency  and  Unbiasedness  of  Certain  Ron- 
Parametric  Tests."  Ann.  Math.  Stat.,  22,  1951/  P«  165- 

20.  Andrews,  P.  C.,  "Asymptotic  Behavior  of  Some  Rank  Tests  for  Analysis 
of  Variance , "  Ann .  Math .  Stat . ,  25,  195^/  P*  724. 

21.  Hodges,  J.  L.,  and  Lehmann,  E.  L.,  "The  Efficiency  of  Some  Ron- 
parametric  Competitors  of  the  t-Test, "  Ann.  Math.  Stat.,  27,  1956, 
p.  324. 

22.  Noethe,  G.  E.,  "Asymptotic  Properties  of  the  Wald-Wolfowitz  Test  of 
RandomnesB, "  Aim.  Math.  Stat.,  21,  1950,  p.  231. 

23.  Smirnov,  N.  V.,  "On  the  Estimation  of  the  Discrepancy  Between 
Empirical  Curves  of  Distribution  for  two  Independent  Samples," 

Bull.  Math.  Unlv.  Moscow,  Serie  Int.,  2,  1939/  P*  3* 

24.  Massey,  F.,  "A  Rote  on  the  Power  of  a  Ron-parametric  Test,"  Ann. 

Math.  Stat.,  21,  1950,  p.  440. 

25.  Smirnov,  H.  V.,  "Table  for  Estimating  the  Goodness  of  Fit  of  Em¬ 
pirical  Distributions,"  Ann.  Math.  Stat.,  19,  1948,  p.  279. 

26.  Hoeffding,  W.,  "Optimum  Ron-parametric  Tests,"  Proc.  2nd  Berkeley 
Symposium,  Univ.  of  Calif.  Press,  1951/  p.  83. 

27.  Middleton,  David,  An  Introduction  to  Statistical  Communication 
Theory,  McGraw-Hill  Book  Company,  Inc.,  i960. 

28.  Baghdady,  E.  J.,  ed..  Lectures  on  Communication  System  Theory, 

McGraw-Hill  Book  Company,  Inc.,  1961. 

29.  Price  and  Green,  "A  Communication  Technique  for  Multipath  Channels," 

Proc.  IRE,  46,  March,  1958,  pp.  555-570. 

30.  Turin,  G.  L.,  "An  Introduction  to  Matched  Filters,"  IRE  Trans,  on 
Inf.  Theory,  vol.  IT-6,  June,  i960,  p.  310- 


-190- 


31.  Key,  Fovle,  and  Haggerty,  "A  Method  of  Designing  Signals  of  Large 
Tine - Bandwidth  Product,"  Lincoln  Lab.  Beport  Ho.  4100007  (April,  1961) 

32.  Oerst  and  Diamond,  "The  Elimination  of  Intersymbol  Interference 

by  Input  Signal  Shaping,"  Proc.  IHB,  49,  7,  pp.  1195-1203  (July,  1961) 

33.  Shannon,  C.  E.,  "A  Mathematical  Theory  of  Caanuni cation, "  Bell 
System  Technical  Journal,  vol.  27,  Ho's  3  and  4,  July/October,  1948. 

34.  Hamming,  K.  V.,  "Error  Detecting  and  Error  Correcting  Codes," 

Bell  System  Technical  Journal,  vol.  2?,  Ho.  2,  April,  1950. 

35 •  Bose,  It.  C.,  and  Ray-Chandhuri,  D.  K.,  "On  a  Class  of  Error 

Correcting  Binary  Group  Codes,"  Information  and  Control,  vol.  3, 

Ho.  1,  March,  i960. 

36.  Bose,  B.  C.,  and  Bay-Chandhurl,  D.  K.,  "Further  Results  on  Error 
Correcting  Binary  Group  Codes,"  Information  and  Control,  vol.  3, 

Ho.  3,  Sept.,  i960. 

37.  Gorensteln,  D;  Peterson,  W.  W. ;  Zierler,  H;,  "Two-Error  Correcting 
Bose-Chandhurl  Codes  are  Quasi-Perfect,"  Information  and  Control. 
vol.  3,  Ho.  3,  Sept.,  i960. 


r 


-191- 

APPENDEC  I 


EVALUATION  OF  A  CERTAIN  INTEGRAL 
Consider  the  Integral  (Eq.  3-6) 
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or 
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which  is  identical  to  Eq.  (3-7)* 
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APPENDIX  II 

DERIVATION  OF  THE  OPTIMUM  s(t) 

To  show  that  the  input  signal  must  he  from  a  stationary  Gaussian 
random  process  for  the  Rayleigh  channel  to  obtain  capacity,  consider 
the  following  channel. 

s(t)  - [TJ - >f - x(t) 


Gs(f>  2W 


r 


n(t) 

Gaussian 
E[n2(t)]  =  N 

E[n(t)]  =  0,  0(f)  =  N_  =  N 
n  2W  ° 

I[S/X,  A  =  is  defined  as  the  average  conditional  information 

rate  averaged  aver  all  x(t),  given  that  A  =  A^. 

To  see  that  the  average  conditional  information  rate  is  a  maximum 

when  8 ( t )  is  Gaussian,  let  A  s(t  *  kjrr^,  be  a  random  variable  with 

2  2 

power  constraint  P’  ^  A  B[s^  ]  and  n(t  *  k)  =  n^,  a  Gaussian  random 
variable  with  Etn^)  =  0,  and  E[n^]  =  N.  Also  denote  x(t  =  k)  =  x^,  then 

E  (x/)  =  E  (rk2)  +  E  (n^)^  P’  +  N 

The  average  uncertainty  of  is  equal  to  that  of  x(t)  since  x(t) 
is  a  stationary  process, 


H(X)  =  |  log  2*  e(P*  +  N) 
This  can  be  shown  by  considering 
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Using  the  fact  that  lnt  6:  t-1,  equality  if  and  only  if  t  «  1,  one 
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It  has,  therefore,  been  proven  that  H(X)  obtains  its  maxi mum  when 
is  Gaussian  with  zero  mean  and  variance  (P*  +N).  If  this  condition 
is  satisfied 
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n 

will  "be  Gaussian  with  zero  mean  and  ) 
Gaussian  with  zero  mean  and  a  variance  equal  to  F' 


C  *  max  l(R/x) 
P(sk) 


P'  +  H  if  rk  is 
Hence, 
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=  max  -|h(x)  -  H(X/lt)i 
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The  maximum  H(x)  has  heen  obtained  above.  It  must  further  be  shown 
that  for  Gaussian  distributed,  H(X/s)  is  a  minimum. 


Solving  for  H(x/r=rk) 
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It  has,  therefore,  been  shown  that  r^  and  hence  must  be  Gaussian 
with  zero  mean  and  variance  P'  »p/  in  order  for  the  average  conditional 
rate  to  be  a  maximum. 

The  average  information  rate  is 
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To  maximize  l(S/Y)  the  Integrand  oust  be  maximized  for  every  value 
of  A^.  The  Integrand  la  maximized  if  l(s/X,  A  *  A^)  la  maximized  for 
every  value  of  A^.  In  order  for  l(s/x,  A  =  A^)  to  be  maximized  it  was 
proved  that  a(t)  had  to  be  a  8tatlonary  Gaussian  random  process  with  zero 
mean,  and  a  variance  F 1 . 
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AFFEBSZX  III 

determhhmg  the  lower  bouhd  of  p 

n 

Starting  with  Eq.  (3-15')  letting  a  -  — - 

&  Pmin 

P  may  be  expressed  as 
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This  is  the  result  stated  in  Eq.  (3-16). 


(IH-1) 


(IH-2) 


(III- 3) 


(lH-4) 


-198- 

APPENDIX  IV 


DERIVATION  07  THE  HAMMING  ERROR  RATE  EQUATION 


1,  Glossary  of  Symbols 

This  glossary  is  intended  to  aid  the  reader  in  following  the 
proofs  presented  by  obviating  the  necessity  of  searching  the  Appendix 
for  symbol  definition. 

Operators,  Relationships 

•  :  Written  a  $  b,  where  a  and  b  are  m  binit  binary  numbers. 

Treat  each  of  a  and  b  as  ah  m- dimensional  vector  with 
elements  from  the  modulo  2  field  (Modulo  2  field:  contains 
two  elements,  0,  1,  with  0+0  *  1+1  =  0,  and  0+1,  =  l)  and 
add,  conponent  by  component, 

yi:  Sum,  under  the  conditions  of  t,  of  n  binary  numbers. 

i*l 


u 


u 

i=l 


e : 


/: 

P{a}: 
P{a|b) : 


Written  a  U  b,  vhere  a  and  b  are  sets,  a  U  b  is  then  the 
set  of  all  elements  belonging  to  a  or  b  or  both. 

The  set  of  all  elements  belonging  to  one  or  more  of  the 
sets  being  united. 

Written  aeb,  where  a  is  an  element  of  the  type  found  in 
set  b  (for  example,  a  itself  may  be  a  set,  and  b  a  set 
of  sets  of  the  same  type  as  a).  Meaning,  "a  is  a  member 
of  the  set  b,  ”  or  "belongs  to." 

See  e;  11  does  not  belong  to." 

Probability  of  a. 

Probability  of  a,  given  b* 
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Variables 


V 


T 


ej: 

1±(P): 


1i: 


m: 


m 


1- 

M  * 

i  * 


Binary  number,  1 4  4  n  =2  -1,  m  binits ;  member  of  the 

set  (dj) 

Binary  number,  Oe  e^f  n  =  2m-l,  m  binits;  the  binary  re¬ 
presentation  of  the  position  number  (l,  . ..,  n)  for  a 
binit  in  error  in  a  received  code  word,  not  including 
the  overall  check  binit  of  the  EED/SEC  case;  member  of 
the  set  (ej) 

As  for  e.,  for  the  code  word  after  the  error  correction 

J 

procedure  of  the  decoder  has  heen  applied 
Number  of  sets  (dj)  belonging  to  X^(p);  shown  to  be  con¬ 
stant  ,  =1^  for  all  p* 

See  l^p).  n 

Humber  of  sets  (d.)  belonging  to  U  X  (7);  shown  to  be 
equal  to  nl^. 


7=1 


Length  of  the  binary  numbers  d y  ty  e'y  p  and  7 • 


m1(p):  Number  of  sets  (d^)  belonging  to  ji^(p);  shown  to  be  con¬ 


stant,  =m^,  for  all  p. 


See 


mA(p). 


Humber  of  sets  (d.)  belonging  to  U  (7);  shown  to  be 

«J  —  T  J* 


equal  to  nm^ . 


7=1 


n: 


Length  of  a  SEC  code  word,  in  binits;  the  number  of  values 
t  may  b< 
n  =  2m-l). 


that  may  be  assumed  by  dy  ey  ey  p  and  7.  (Note  that 
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i  *  • 


rr 


V1!1' 


H 

V^i): 


V(m±)s 

Vvi): 


Cvt): 


yj 


Length  of  a  DED/SEC  code  word;  n  -  n'-l  for  such  codes. 
Humber  of  errors  In  the  first  n  blnits  of  a  received  word. 
Humber  of  errors  in  the  first  n  binits  of  a  received  word 
after  "correction" . 

Humber  of  sets  (dj)  belonging  to  v^. 

Humber  of  errors  in  total  received  word,  =  ne  for  SEC 
codes,  *  n^  or  n^-1,  SEC/BED  codes. 

Same  as  n^. 

Number  of  times  p  is  used  as  an  element  in  the  sets  (dj) 
n 

belonging  to  (J  X±(r );  shown  to  be  constant,  H^), 

r=i 

for  all  p. 

See  Hp(l^). 

Humber  of  times  p  is  used  as  an  element  in  the  sets  (dj) 
n 

belonging  to  IJ  ^(7);  shown  to  be  constant,  N^), 

7=1 

for  all  0. 

See  N^^). 

Humber  of  times  p  is  used  as  an  element  in  the  sets  (d^) 

belonging  to  v^j  shown  to  be  constant,  =  N(v^),  for  all  p. 
See  N^). 

Channel  probability  of  error;  for  symmetric  channels, 
transitional  probability. 

Omission  index.  (SEC/lSD  codes  only),  y  ■  0  if  the  re¬ 
ceived  error  pattern  can  be  detected  but  not  corrected, 
tod,  therefore,  the  whole  code  word  is  discarded;  y  -  1 
if  the  code  word  is  not  discarded. 
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P^:  Decoder  output  binit  error  probability 

z:  Check  index  (SEC/DED  codes  only),  z  =  1  if  the  overall 

check  binit  is  received  in  error,  and  z  =  0  if  the  over' 
all  check  binit  is  received  correctly  (at  the  decoder 
input  in  both  cases). 

p:  Binary  number,  1  p  n  =  2m-l,  m  binits  in  length. 

7:  As  for  p. 


Sets 

(d.):  Set  of  unique  binary  numbers  d.  (see  d,). 

«J  J  J 

(e^):  Set  of  unique  "binary  numbers  e^,  each  corresponding 

to  an  error  in  the  received  code  word  (see 

(e*):  Set  of  unique  binary  numbers  e’,  each  e*  corresponding 

J  J  J 

to  an  error  in  the  received,  "corrected”  code  word 
(see  e^,  e^)  . 

X^p):  Set  of  all  (d^),  where  the  number  of  elements  in  (d^) 

i 

is  i  satisfying  d^  =  p  £  0,  and  p/(dj). 

J-l 

H  (p):  Set  of  all  (d.),  where  the  number  of  elements  in  (d.) 

l  j  J 

i 

is  1,  satisfying  I*  aj  -  ^  • 

j=i 

v. :  Set  of  all  (d.),  -where  the  number  of  elements  in  (d^) 

1  J  V 


is  i,  satisfying  )  9  d^  =0 
J=1 
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2.  Theorem 

Tot  all  non-repetitive  sets  (d^)  of  elements  d y  each  such  element 
being  the  binary  representation  of  a  number  from  the  set  (l,  2,  . n), 
n  ■  SEC  code  word  length  ■  2m-l,  m  an  integer,  form  the  sets  of  sets 
\(p)j  ^(p)  an<*  vi  thus: 

Ai(p)  =  The  set  of  all  sets  (dj)  containing  i  elements  and  satisfying 


®  dj  =  p  f  0,  with  p€(dj); 


^(p)  =  The  sets  (dj)  containing  i  elements  and  satisfying 
i 

dj  =  p€(dj)  (inlying  p  /  0  as  well); 


vi  =  The  set  of  all  sets  (d. )  containing  i  elements  and  satisfying 


V° 


Define,  then,  l^p)  =  the  number  of  distinct  sets  (d^)€  X^p) 
m^(p)  ®  the  number  of  distinct  sets  n^(p) 


the  number  of  distinct  sets  (dj)e  vi 


and  N0(X*  )=  the  number  of  times  8  is  used  as  an  element  in 

P  i 

n 

the  distinct  sets  (d.)e  U  X. (7) 

J  Ly-l  1  J 

N0(n,  )  =  the  number  of  times  p  is  used  as  an  element  in 
P  n 

the  distinct  sets  (dL^  )e  11^(7) 

Np( vi )  ^  the  number  of  times  p  is  used  as  an  element  in  the 

distinct  sets 


the  distinct  sets  (d.)e 
J 
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Then  it  is  postulated  that  1. (p),  m. (p),  and  Na(X, ),  IL(n, )  and 

1  1  pi  pi 

Np(vi )  are  each  independent  of  p,  1*  pi- n  =  2m-l,  for  a  fixed  i. 


Corollary: 


_  n-i+1  n 

mi =  ni-i 

ni  “  f  1i-l 


N(Xi)  =  il± 
ir^)  =  in^ 


m. 


N(vt) 


in. 


n 


where  m.^,  1^,  N(Xi),  N(^i),  and  N^)  are  the  constant  values  taken  on 
"by  ^(p),  l^p),  H^X^,  and  respectively,  for  a  fixed  i  and 

any  p,  1  ^  p  ^n . 

Proof:  The  method  of  proof  to  be  used  is  mathematical  induction. 

Parts  (l)  and  (5)  establish  that,  if  the  theorem  is  true  for  i  -  1,  it  is 
then  true  for  i.  Part  (6)  shows  the  theorem  to  be  true  for  i  =  1,  com¬ 
pleting  the  proof. 

It  is  implied  throughout  the  proof  that  each  set  (or  set  of  sets) 
referred  to  is  non- repetitive  in  its  elements  (or  sets). 

Assume,  now,  that  the  theorem  is  true  for  1-1;  the  inductive  proof 
follows . 

(l)  Consider  the  sets  (dj),  (dj)€  vi_i>  since  a  given  p  appears  once, 
at  most,  in  any  one  (dj),  the  number  of  sets  (d^)e  vjL_1  such  that 
0^(dj),  is  •  Adjoining  p  to  each  such  set  results  in 

+he  formation  of  [ni_1-H^(v1_1)]  distinct  sets  (dp,  each  of  whose  sum 
(•)  is  p,  and  each  containing  p.  Thus,  each  such  (d^  )e  n^(p),  and 

”i(e>*Vl-Vvi-i> 
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Conversely,  for  every  set  (dj )e  p^(p),  deletion  of  p  from  each 
(dj)  results  in  a  set  of  distinct  sets  (d.^ ),  with  (d.^  )e  and 


p/(dj)  -  i.e., 


ni-i-Vvi-i)smi(p) 


Thus,  11^(0)  =  ni_j-Np(vi_i);  since  n^_1  and  Hp(v^_p  are  independent 
of  0,  3^(0)  is  similarly  independent. 

(2)  With  each  (d.^  )e  containing  (i-l)  elements,  associate  the 

each  (d*)  so  formed  has  the  property  that  (d')e  \i 
J  J 

every  (dp€  ^(5)  may  he  associated  with  exactly  one  (dj)e  hy 

deletion  of  5,  and  that  (d.)  has  the  property  that  &/(d.). 

J  J 

Ulus,  associated  with  each  of  the  s®ts  in  containing 

p  n 

a  given  0  are  (n-i*fl)  unique  sets  belonging  to  (J  ^(7)  [n<>te  that  none 

7=1 

of  these  sets  can  belong  to  ^(0)].  Also,  with  each  of  the  [n^^-Hpfv^)] 

sets  in  not  containing  0,  there  is  associated  exactly,  in  one-to-one 

n 

correspondence,  one  set  in  (j)  ^(7)  [in  particular,  belong  to  ^(0)], 

7=1 

such  that  each  such  set  contains  0.  finally,  then,  the  total  number  of 
n 

sets  in  U  ^(7)  containing  0  is  (n-i+ljN^v^)  +  n^-H^v^)  “  or, 


±\).  Conversely, 


n-(i-l)  sets  (d^)  formed  by  adjoining  6^  to  (d^ )>  for  each 


V>li)  =  +  ni_! 

With  and  n^_^  independent  of  p,  H.(^)  is  similarly  independent. 

(3)  Consider  the  sets  (dj)  such  that  (dj )e  and  pc(dj )  for  a  given  p. 

Sy  deleting  p  from  each  (dj),  a  set  of  nev  distinct  sets  (dj)  is  formed, 

i-l 

dj  -  and  P^(dj)  ”  1'e‘>  (dj)e  Xi-1^^* 
J-l 


and,  for  each  such 


<V" 


I* 
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Comrersely,  every  (d^)e  X^_^(p)  may  be  associated  uniquely  with 
exactly  one  set  (dj)  »  (dj,  p)  in  v^. 

Thus, 

VVi}  =  1i-l(p) 

Since  is  independent  of  p,  Hg(vi)  is  similarly  independent. 


00  The  sets  of  sets  X^(y),  ^(7)  and  are  disjoint  and  exhaustive 
in  the  set  of  all  sets  of  i  binary  numbers  chosen  out  of  the  binary 
numbers  (l,  2,  . ..,  n  =  2m-l)  --  that  is,  any  set  of  i  binary  numbers 
(and  there  are  (°)  such  sets)  belongs  to  exactly  one  of  the  (2n+l) 
sets  >^(7),  1*  7  4Dj  ^(r),  l*-7  and  v±. 

Also,  in  the  set  of  all  i-element  sets,  each  p,  li-p^n,  is  used  as 
an  element  an  equal  number  of  times  —  specifically,  each  p  is  used 

^(°),  or  (°“^)  times.  It  is  established  in  (2)  and  (3)  that,  given  a 

n 

p  used  N  (n.)  times  as  an  element  in  the  sets  of  (J  n  (7)  and  Nfl(v. ) 

P  X  7  =1  1  P  1 

times  in  the  sets  of  v. ,  BL(n. )  and  Na(v.  )  are  independent  of  6,  It 

i  P  1  P  1 

follows  that 


w  •  o  •  ■  w 


with  JSL  (  .  )  independent  of  ^  . 
P  1 


(5)  Consider  a  set  (dj)e  X^(p);  form  a  nev  set  (dj  )  by  deleting  d^ 
from  (dj),  UkM,  and  adjoining  p. 

Then,  recalling  that,  in  modulo  2  vector  arithmetic,  a  ©  b  =  a  •  b 
(0  =  vector  "subtraction,"  elements  from  the  modulo  2  field),  then 


I*  4j*  ■  I*  \  •  o  -  e>  •  \  •  o  -  V 

J*1  J-l 

and  d^  (<3^)  -  i.e.,  (d^JeX^) 
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Thus,  it  is  demonstrated  that,  for  each  (dj )e  X^(p),  there  are 
exactly  i  associated  sets,  one  each  in  each  of  X^dj),  1  J  i,  con¬ 
taining  p;  it  is  obvious  that  no  two  different  (dj)e  X^p)  can  be  so 
associated  with  the  same  (d^  )  in  some  X 

(dOe  X.  (ft)  with  pc (d* )  must  be  associated  with  exactly  one  (d.)e  X. (p), 
J  1  o  n  J 

Since  the  total  number  of  sets  in  Q  X.  (7)  containing  p  is  Nft(X . 


^(d^),  and  that  every 


the  number  of  times  p  is  used  as  an  element  of  these  sets,  it  follows 
that  the  number  of  sets  in  Xi(p)  is  given  by 

W 


i±(p) 


,  i  t  0 


Since  ND(X,)  is  independent  of  p,  similarly  1.  (p)  is  independent  of  p. 
pi  1 


(6)  Finally,  consider  the  case  for  i  =  1. 
of  a  single  element  d^.  For  every  such  set. 


Then  every  set  (d.)  consists 
i  0 


j  ■  d1  €(dj);  thus 


J-l 


every  set  (dj)  e  n^(d^),  and  m^(p)  =  1,  for  all  p,  1  -  P- n.  Also, 
l^p)  =  0  and  Hp(X1)  =  Np(Vi)  =  0,  =  1,  independent  of  p. 


(7)  Since  l^p),  m±(p),  Np(Xi),  and  Np(Vi)  are  all  independent 

of  the  p  chosen,  redefine 

\  =  1i^^;  mi  =  ajxd 

Np(Xt)  =  N^);  I  =  H^);  Hp(vi)  =  N^). 

Summarizing  then,  it  has  been  shown  that 

mi  =  ni-i-N<vi-i> 

N(nt)  =  (n-i)K(vi_1)  +  n±_1 

N(Vi)  =  1^ 

N(X1)  =  (J’J)  -  N(n±)  -  M(vi) 
lt  =  H(Xi)/i 


(IV-1) 
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Also,  in  the  set  vi  of  ell  i-length  sets  whose  sum  is  zero,  the 
total  number  of  elements  is  in^;  but  each  of  the  n  elements  (l,  . n) 
is  used  an  equal  number  of  times,  so  that  the  number  of  times  any  one 
element  appears  in  these  sets  is  given  by 


”<vi)  ■  TT 

(IV-2) 

Using  (IV-I)  with  (IV-2),  it  follows  that 
(n-i+l)n^  x 
mi  - - n - 

(iv- 3) 

n  h-i 

ni  =  i 

(iv-iO 

-  1  /H  \ 

\  =  n  [(i)  '  ni  J  '  “i 

(IV-5) 

*(^)  -  i  \ 

(IV-6) 

-  i  »± 

(IV-7) 

i  n 

»(»i>  ■  ~r 

(IV-8) 

(9)  The  following  lemma  results  immediately: 

Lemma 

The  probability  that  an  arbitrary  non- repetitive  set  (dj)  of  i 
binary  numbers  chosen  from  the  set  (l,  2,  n*2m-l)  is  such  that 

(a)  (dj)eX  ±(P)>  is  given  by  l±/(“); 

(b)  (dJ)en1(p),  is  given  by 

(c)  (dj)svi,  is  given  by  njL/(“). 
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(IV-9) 

(IV-10) 

+  P{  (ej)e  X1(p)|ne=i  ) 

--  with  the  X^fr),  ^(7)  and  v  all  disjoint,  this  becomes 
P{p€(ep|ne«i}  =  PtMep,  (ej)e  vt  |ne=i} 

+p|  peve^),  (ej)e  U  ^(7)  |n,-ij 

7=1 

(7/0) 

+pjp«(ej),  (*j)c  U  X±(7)  |ne-i|  +  «  (e^e  X^p)  |ne=i}  (IV-11) 

7-1 

(7  fa) 

P(Pe(ei)  Ue-i)  =  P(p€(ej)|  (e^Je  v±,  ne=i)  P(  (e^Js  v±  liy-i) 

+p|pe(e^)|  (ej)e  \J  ^(7)]  »  nemi}  P  {^®J^€  U  M7^] 

7=1  7=1 

(7  fa)  (7  fa) 


3.  Error  Rate  Equation,  SEC  Hamming  Codes 


For  these  codes,  the  length  n  =  2-1.  Then, 

XL 

Probability  that  the  p  binit  is  in  error  after  correction  = 
P  (Me')}  *  /  P(pe(ep  |ne=d)P  lhe=i} 

P  (3«(ej)  |ne=i}  -  p|  pe(ej),  X*  f  Pi”.'1} 

+  p|  «j  -  P  lnesi} 

=  P  ^peCejJ^ejJe  |  1J  ML(7)]lj[  U  \(7)  Uv1j*lne=i| 


7 -1 
{.7  fa) 


7=1 

{7  fa) 
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+pjp«(«j)  |  (ej)e  |\j^  X^?)]  >  V1  }  P  {^epe  Xi^]  I  V*1  } 
(r/e)  (rb) 


+  P((ej)e  Xi(3)|ne«i ^ 


(lV-12) 


(2) 


P{  (ej)e[  U  M7>]  K=i} 

<3»> 


Humber  of  (e  )e 
J 


[  u  »i<io . 


r=i 

jfc&L 


Total  number  of  (e.) 

J 


(IV-13) 


■with  the  H^(7)  disjoint, 

n 

Number  of  (e^Je^  (J  4^7)]  =  ^  Humber  of  (e^Je  4^(7) 


7=1  7=1 

(rb)  (7b) 


ffk) 


^(7) 


—  but  111^(7)  *  ^ )  independent  of  7  •  The  numerator  then  becomes  (n-l)m^ 
The  denominator  of  (IV-13)  is  merely  (^);  thus, 

(n-1^ 


r  r  n  1  -N  (n-lji 

{(•jH  u  m<r)J  In.-1}-  — ^ 

7=1  V 

(7^) 


( 17-14) 


Similarly, 


(n-l)l^ 


r  r  n  1  ^  ln-i 

p  u  i(r) 

7=1  V 


(IV-15) 


(7b) 


P  ^  (*j)e  vi(P)lne= 


^i 

<?> 


and 


PI  (ej)€  ^OOlv  1)  .  -i 


(?) 


(IV-16) 


(W-17) 
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(3) 


pjp6  (ej)  |(ej)  \J  ^(7)  ,  n#  *  i  } 


7=1 

iyh) 


Humber  of  (®j)€  f"  U  H^(7  )J  such  that  06  (ej) 
L  7*1 

_ _ 


Total 


number  of  (e^  )e (J  ^(7)  j 


7=1 

(7&) 


How, 


Humber  of  (e^Je^  U  ^ (7 ) j  such  that  Pe(«j) 

L  7=1 

(7&) 

=  Humber  of  (ej)€|^  U  ^(7)]*  with  P^j) 

L  7-1 


(IV-18) 


Humber  of  (e^eii^p)  with  0e(ej). 


(IV-19) 


Humber  of  (e^)e  1J  ^(7)^  vith  0e(ej)  =  N^),  while 
L  7=1 

all  (e^)€ti1(p),  (=®^)  satisfy  0e(ej).  Thus,  the  numerator  of 
(lV-l8)  becomes 

H^)  -  m1  =  (i-lja^ 

Again,  since  the  ^(7)  are  disjoint, 

n 

Total  number  of  (e^Je  £  U  >^(7)^  *  Humber  of  (ejjc^fr) 

b%) 

=  m1(7)  -  (n-l^ 

7=1 

(7/0) 


(17-20) 


i 

i 

■* 

I 

A 

i 

I 

I 

I 

1 

! 

i 

* 

i 

i 

I 


So  that 


p[p€(eJ)|(eJ)€[  ^(7)]  >Vi}*IS 

(r/p) 


Similarly, 


(IV-21) 


{p€(eJ)|(e<J)€[  X±(r)]  ,ne=ij 

(r&) 


Number  of  (e  )e 
J 


[U  \0)  ] 


such  that  pe(e.) 

J 


»  » i«  ■  g 

Total  number  of  (ej)eJ^  U  ^(7)  j 

(7~fa) 


(IV-22 ) 


r  r  n  i  1  h(\  )  4 

'{  P*<«j)l  7U  xi<r)J  ,  v  1}  '  TZTS\  *  SI 

(r/p) 

since  for  every  (e^ )e>»i(p)J>  p^(ej); 
also, 

,  N(v  ) 

PtpeO^Ke^,  ne=  ij  =  —  =  - 

Substituting,  (IV-12)  becomes 


(lV-23) 


(IV-24) 


P{pe(e’)|ne=  i) 


i  (°'1>mi  1  1 

"  '  (J)  "•1  '  (?)  "-1  ’  (?)  (J) 


^{^T  +  U-i)-!  ♦  (t«)  it}  • 


(IV-25) 
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Define : 


M. 


N. 


(IV-26) 


Then 


P{pe(e')|n  -  1}  -  [  (l+l)  L  +  il^  + 

J  n^)  L 

and  the  parameters  are  given  by 


(iv-27) 


M±  =  (n-i+1) 

H1  “  I  Li-1  (IV-28) 

Li  •  (?)  -  *1  -  *1 

with  Initial  values  *  n,  -  0 

(or,  alternatively,  *0  "  L0  "  °>  Ho  "  1>* 

(5) 

P{n  =  1}  =  (?)  P  *(l-P  )n~*,  where  P  =  channel  probability  of  error, 
e  x  e  e  e 

Equation  (lV-9)  becomes 


»»  ~i 

POe(ep)  =  Y^n  [(1+1)Li  +  iMi  +  (^mJ  P^Cl-P^"1  (IV-29) 

i~=0  L 

(6) 

P^  =  probability  that  an  arbitrary  information  binit  is  in  error  at 

the  decoder  output  =  ^  (Prob.  that  the  arbitrary  binit  =  a  specific  info. 

info  bits  blnit  in  the  code  word)  (Prob.  that  the 
in  the  code 

word  specific  info,  binit  is  in  error). 

Since  the  probability  that  any  specific  binit  0  in  the  code  word  is  in 

error  after  correction,  P{0e(e’)},  is  independent  of  0,  this  is  also 

J 

the  probability  that  any  info,  bit  is  in  error.  Hence, 
p;  -  P{0e(ej)} 
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p;  =  “  Yj  *i  +  iNi  +  ^+1^Li  Jpei(1-I,e)n’i  (IV-30) 

i=0  L 

In  actual  computation,  the  coefficients  of  the  terms  for 
i  =  0,  i  *  1  are  both  zero;  the  summation  may  start  at  i  *  2 . 


k.  Error  Rate  Equation;  SEC/PED  Hamming  Codes 

For  these  codes,  is  defined  as  the  probability  that  an  arbitrary 
information  binit  is  in  error  after  decoding  given  that  the  code  word 
was  not  discarded  by  the  decoder.  Then,  the  desired  probability,  anal- 
agous  to  3.,  is 

Probability  that  the  binit  is  in  error  after  correction,  given 
that  the  code  word  is  not  discarded  = 

p(P  (ej)|y  -  U  «  pr~rr PO  (ej )>  y  =  i)  (17-31) 

n 

=  Plfej  {  I  p(pp  (ej^  y  *  h  z -  0,  nt  =  i} 
i=0 

n+1 

+  y  p(p  (e‘),  y  =  1.  z  =  1.  nt  =  i)| 

1=1 


where  the  length  of  the  code  word  is  n  =  n+1  =  2m;  z=0/z=l  indicate 
that  the  overall  check  binit  is  not/is  in  error,  respectively,  and 
y= O/yel  indicate  that  the  code  word  is/is  not  discarded. 

Again,  n 

PO  (ep  y=l)  Y,  P{p  ^V1'  z=0)  p(2=°lvi5  p(vi] 

i^O  ° 

n+1 

.  £  m  (ej),  y=l|nt=i,  z=l)  P{z=l|nt=i}  P{nt=i}| 

1=1 


(IV-  32) 
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(1) 

Fbr  a  code  word  to  be  discarded,  two  sets  of  conditions  may  be 
imposed. 

(a)  The  overall  parity  check  is  zero,  while  the  check 
word  is  not.  ThlB  detects  and  discards  all  double  errors, 
as  well  as  the  majority  of  patterns  of  all  other  even 
numbers  of  errors. 

(b)  The  conditions  of  (a)  are  satisfied,  or  the  check 
word  is  zero  while  the  overall  check  is  not.  This  detects 
and  discards  a  large  number  of  error  patterns  with  odd, 
>1,  errors;  however,  it  will  also  discard  the  single 
one-error  pattern  in  which  the  error  occurs  in  the  over¬ 
all  check  binit. 

The  error  rate  equation  under  conditions  (a)  is 
developed  in  detail,  while  that  for  (b)  is  stated 
without  proof. 


P(&e(e’),  y  =  l|nt  =  i,  z  =  0) 

*  P  y*  y  =  l|nt  =1,2=0! 

+  P  I*  eJ  ■  O'  y  -  '•K  ■  2 '  °} 

—  with  n ,  =  i  and  z  =  0,  then  n  =1. 
u  e 


(iv-33) 
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Pollowlng  the  method  of  3- (l)>  this  becomes 
P(Mej)>  y  »  l|nt  »  1,  z  -  o) 

-  POe(ej),  7  m  1lne  "  11 


+  P 


(ej)€[  1(7)  ]'  7  "  l|ne”  1  } 

(r/e) 


+  P  |pe(ej)>  (ej)e[  Uxi(r)  ],  y  -  l|ne-  ij- 

7-1 

(7  fa) 

+  p((cj)eXi(P)>  y  =  l|ne=  1) 

Pbr  odd  n  ,  y  *  1;  for  even  n  ,  however,  y  =  1  and  (e.)c|i  (7) 

e  e  J  ne 

or  X  (7)  for  some  7  cannot  both  occur  simultaneously,  For 
ne 

(e.Jev  ,  y  *  1  for  all  n  ,  even  and  odd. 
j  n^  e 

Thus, 

P(P€(ej)>  y  =  l|nt  =  1,  z  =  0}  =  P{pe(e^),  (ejjcvjr^-  1},  i  even 


PfMej),  (ej)€Vilne 

-  1) 

r 

r  n  n  'i 

+  P  (ej)e 

U  u±(r)  J  |v  lj 

(rk) 

f 

r  n  1  i 

+  P  |p€(ej),  (ej)e 

.  Ji Xi<,)  -1 |n'’  *} 

(7fa) 

+  P  [(ejJeX^p)!^-  i),  i  odd 


(IV- 34) 


(IV-35A) 


(IV-35B) 
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(3)  Mow, 

P(pe(ej),  (ejJe^  »e*  i) 


p(p6(eJ),(e.J)evi'  V  i]  p(<ej)«Vi|ne«i}  (W  36) 


[  Ul‘h(7)]  'v1} 

(r&) 


■  p[s.(ej)l(«j)«[  LU^Oo]  ,  nt.  i}  b[  (*j)«[  u^tr)]  l»e-  l}  ; 

bk) 


r« 

(r/p) 


(iv- 37) 


and 
p 


(•j)«[ui  H<7>  )  V 
irk) 

p Xi(r)  ],  a.-  i}  p{  <'j){7U  V71]  I”.-  1 } 


(r/p)  (r^p) 

Using  these,  with  (lV-l4)  through  (lV-23),  (IV-35A,  B)  become 


(IV- 38) 


P{pe(ep,  y  =  l|nt  =  i,  z  =  0) 


in. 


n(J) 


,  i  even 


P(pe(ep,  y  =  l|nt=  i,  z  =  0)  =  +  (i-ljm^  (i+l)!^  ,  i 


(IV-39A) 


odd 

(IV-39B) 


(4) 

In  a  similar  manner,  with  n^=  i,  z  =  1  (then  n^=  i-l), 
P{pe(ep,  y  =  ljnt=  i,  z  =  1) 

*  P(pe(ej),  (e^Jev^,  y  =  l|ne«  i-l) 
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+  (ej)e[ryL  ^-1(7)] ' y  =  1,ne“ i_1} 

irfo) 

+  ^(ejJcX^^p),  y  -  l|ne=  1-1}  (IV-40) 

obtaining 

y  =  l|nt=  1,  z  =  1} 

(i-l)n,  , 

« -  i  even  (IV’-^IA) 

n(  ) 

i-1 

_  r  (i-l)n.  ,  ^ 

=  -Hr:  {  n  " +  (^i-i +  “i-i}' 1 044  (IV'4lB) 


(5) 

For  an  arbitrary  received  error  pattern  containing  i  errors. 


P(z  = 

o 

=  i} 

nf-i  n-i+1 

n1  “  n+1 

(iV-teA) 

and 

P(z  =l| nt= 

1}  = 

i 

n+1 

(IV-1+2B) 

Also, 

F(V 

i}  = 

/n+1 
1  i 

)  p  1  (i-p  )n+1_i 
'  e  x  e ' 

(lV-^3) 

(6) 

finally,  substituting  (IV-39A,  B)  through  (lV-43)  into  (IV- 32), 


P(pe(e')|y 


1} 


i=0  nV 


Cl1) 


?  1(i-p  )n+1_1 

e  x  e' 


i=0 
(i  even) 
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♦  J  £  [  £  ♦  <-K  *  [  •&  ]  <°I1)  W1* 

1-0.  V 

(1  odd) 


■l  ti> 

(i  odd) 


1  [  +  tl*2K-i,(l)i-i]  [  *  ]  fIV(W*,M 


•t  [t^] [A] 

i«2  nii-l' 


1-2 

(i  even) 


MOW, 

,n+lx  _  (n+l)!  f  S1L.1  UJ  „  [jSL."]  (n) 

(  1  '  1 1 (n+l-i ) !  [n+l-ij  [_1 ! (n-l) ! J  [n+l-ij  '1 

Tn+ll  n!  T n+ll  /  n  ^ 

=  hr  (i-i)*.[n-(i-i)]Tf =  I  i  J  (i-i) 


so  that 


«M.p|yD  -  Frja,  {  ;  I  lni  pe1(1-p.)"1'1 


i=0 

(i  even) 


u 

i  J  [ini+  (l-ljm^  +  (i+ljnlj  Pei(l-Pe)n+1"i 


1=1 

(1  odd) 


(Ff-kh) 


(IV-45) 


n 

*  |  £  td-lK-l*  t1-2)™!-!  *  lnll-l  Jp/U-Pe)”*1'1 
ii 

(1  odd) 


♦  i£  («K-1'.1&-pIr1-i}  <w-*> 

1=2 

(i  even) 
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Using  (IV- 37); 

p(P€(ej)  y  “  1) 


Hr 


n-1 

MX 


«!  p/u-p.r1-1 


i*0 
(i  eyen) 


n 

£  [1^  +  (i-l)M1  +  (i+1)^)  Pe1(l-Pe)n+1"1 


i=l 
(i  odd) 


U 

Y  [(i-l)Ni_1  +  (i-2)*!^  +  Pei(l-Pe)n+1_i 


i=l 

(i  odd) 
n+1 


I  to-1*!.!  f/d-r.r1'1} 


i=2 
(i  even) 


(7) 

Nov, 


n-1 


n+1 

X  “i 

i=0  i=2 

(i  even)  (i  even) 


“i  r,ld-r.) 


n-i 


--  since  the  first  term  in  the  left  summation  is  zero.  For  Nn+^, 
note  that,  although  it  is  implied  that  the  L^,  and  are  defined 
only  for  0^-i<n,  setting  (^)  «  0  for  i<0,  i>n,  allows  the  iterative 
equations  (lV-28)  for  1^,  M.^,  and  to  he  extended  to  values  of 
i7>n;  a  similar  situation  exists  for  the  rewritten  forms 


N 


i-1  ’  n-i+1 


iN. 


"i-1  i 
Mi-1  *  ^  "  Li-1  "Hi-1  ; 

for  i<  0;  a  brief  examination  reveals  that  the  values  obtained  for 
L^,  M^,  and  are  identically  zero  for  i-<  0  and  i  >n.  In  particu¬ 
lar,  Hn+1  «=  0,  allowing  the  extension  of  summation  of  (IV-48). 


(IV-47) 


(IV- W) 
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Then,  (lV-47)  becomes 

n+1 

PCpe(e')|y  -  1)  -  Sg^-fY  tui+ 

i-2 

(i  even) 
n 

+  ^T  [(i-2)M1.1+  (i-l)Mt+  (i-l)Ki_1+  i H±+  iL^+U+l)^  ]Pg(l-Pe)n+1_i|  (IV-50) 
i-1 

(i  odd) 

(8) 

An  argument  identical  to  that  of  3.(6)  results  in  the  conclusion  that 
P^  =  P  (arbitrary  info,  bit  in  error  after  decoding) 

=  P(pe(ep|y  =  1)  (lV-51) 

°r  n+1 

K  ■  ^u{  I  ilBi+  d-D*!.!)  p/a-f,)"1'1 

i=2 

(i  even) 
n 

+  Y  [(i-2)M1_1+(i-l)Mi+(i-l)H1_1+iNi+iL1_1+(i+l)Li]  P*(l-Pe)n+1'1j  (IV-52) 
i=l 

(i  odd) 


This  may  be  reduced  slightly  by  using  Eq.  (IV-28)  if  desired;  how- 
ever,  the  present  symmetrical  form  is  illustrative  of  the  principles 
involved,  and  is  convenient  for  computer  programming. 


(9) 

P(y  =  l) 


n+1 

=  Y  p(y =  1lnt =  i]  Ptnt 


i) 


i=0 

Now,  P{y  =  l|n^ 
but  P{  y  ■  l|nt 


i)  ■  1,  i  odd  ; 
i)«  0,  i  even  and 


^  0 


f 


(IV-53) 


(IV-5^) 
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Thus,  for  1  even, 

F(y  =  l|nt  =  1)  =  P(y  =  1,  z  -  0|nt  -  i)  +  P(y  -  1,  z  -  l|nt  =  1) 
=  P{y  «  *  i,  z  ■  0)  P{z  =  0|n^  *  1) 

+  P{y  -  l|nt  «  i,  z  -  1}  P(z  -  l|nt  -  1} 

■  PUajJeVj.  ne  -  1}  P(z  »  0|nt  «  i) 

+  PKe^v^J^  «  1-1}  P{z  «  l|nt  -  1) 

Substituting  from  (IV-16)  and  (IV-42A,  B),  this  becomes 


(IV-55) 


P(y  «  l|nt  =  i  }  = 


Using  (XV-45) 
P{y  -  l|nt  =  i} 


n+1 

n+l-i 


+ 


nl-l 

/  n  \  n-H  * 
li-l'  i 


i  even 


[n^  njL_1]  ,  i  even 


(10) 

Using  (IV-55),  (IV- 56),  and  (IV-43),  (IV-53)  becomes 
n  n+1 

P(y  -  1)  -  ]f  (“J1)  P^(l-Pe)n-i+1  +  Y,  [Hi+  Ni-l^  Pe(l"pe)n"1+1 
i-1  i3> 

(i  odd)  (i  even) 


where,  as  before,  Hj=  0,  J<0,  J>n. 

(H) 

A  similar  development  for  conditions  (b)  results  in  the  following 
expressions : 


(IV- 56) 


(IV-57) 
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n+1 

*'t  ■  5pTRt{  1  tlV  ^i-i'  ?.1(1-p.)nt1'1 

1=2 

(i  even) 
n 

+  £  [(i-2)m1_1+  (i-i)  +t+  n»1_1+  (i+ijLj  Pei(i-Pe)n+1"i  I 

1=1 

(i  odd) 

<"d  n 

Pty  ■ 11  ■  { I  1  v  ii-i*  mi  *  mi-i  ip.1(i-p«)°*1"1 
1=1 

(i  odd) 


*  X  “l*  "i-l1 
1=0 

(l  even) 


(IV-58) 


(IV- 59) 
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AFPENSEZ  V 

RESULTS  OF  COMPUTER  SIMULXTIOH  —  BOSB-CHABDHUH  (15,7)  ABU  (15,5)  CODES 


The  tables  included  in  this  appendix  show  the  numerical  results  of 

computer  simulation  of  the  Bose-Chandhuri  (l5>7)  2-error  correcting  code 

and  the  (15,5)  3~®rror  correcting  code.  The  tables  are  arranged  so  that 
th  th 

the  entry  in  the  i  column  and  0  Q  row  is  the  number  of  i -weight  error 
patterns  resulting  in  J  errors  in  the  decoded  information  binits .  The 
coefficient  of  the  ith  term  in  the  corresponding  error  rate  equation  is 
determined  by 


XL 

i  E 


J  B 


J*0 


,  where  B^j  is  the  i  column,  j  row  entry, 


and  k  is  the  total  number  of  information  binits  in  the  code  word  (k  =  7 

5)  code). 


for  the  (15,7)  code;  k  =  5  for  the  (15, 
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AfPEHBXX  VI 

BAMQBO  COSE  ERROR  RAZE  EQKATIDR  CORmCHMTB 


This  appendix  contains  tables  of  the  error  rate  equation  coefficients 
for  the  Bamming  SBC  codes,  and  the  SEC/UBD  codes  operating  under  the  two 
previously  postulated  sets  of  word  rejection  conditions  as  calculated  by 
the  191  7O9O  Digital  Computer. 

Although  each  coefficient  Is  an  integer,  the  size  of  most  of  the 
coefficients  Is  beyond  the  Integer  storage  capabilities  of  most  computers . 
For  this  reason,  the  coefficients  are  presented  in  the  form 
x.xrnxxxExix 

where  the  symbolic  "EXXX"  is  to  be  read  as  "x  10+X**".  Again,  as  a 
result  of  the  characteristics  of  the  computer,  numbers  such -as 
"7. 0000000x10°"  often  appear  as  ”6.99999998  0". 

The  coefficients  presented  are  "A(l)",  to  be  read  as  "a^ ",  where 
n 

P^  =  Y  ai  for  SEC  codes; 

i«0 

and  P f  * 

e  P{word  accepted) 

with 


P( arbitrary  information  blnit  In  error  and  word  accepted) 
n' 

-F  ‘1  ,  for  SEC/DRD  codes; 

i«0 

and  "B(l)n,  to  be  read  as  "b^",  where 


P{word  accepted) 


1  -  P  (word  rejected) 

1  -  [  i  ”1  ]• 


for 


SEC/DED  codes. 


ERROR  RATE  EQUATION  COEFFICIENTS 


HAMMING  SINGLE  ERROR  CORRECTING  COOES 


2  6.9999999E  0 


9  1 •2000000E  I 


n  0*  E 

0 

7 

3*06699976 

3 

12 

3*35999986 

2 

»  2.0999998E 

1 

8 

3*36799976 

3 

13 

8 *39999976 

1 

\  1*1 900000E 

2 

9 

2*91199976 

3 

14 

1 *50000006 

1 

3*91 99997E 

2 

10 

1 *96699986 

3 

15 

1 *000000 0E 

0 

i  1*03600006 

3 

2  4  *4999999E  1 

10*  E  0 


5*74999976  2 

4  *7999996E  3 


5  3*082 7997E  4 

l .5679297E  9 


E 


6*11 91993E  6 

10  1.4800927E  7 


13  8*  7527003E  7 

12  9*  561 9 1 90E 


14  1 • 2056762E  8 


16  1 • 54807896  6 

17  1« 4461 4856  8 


20  5*38552496  7 

21  2*95512316 


•4044872 


24  1 *99003986  6 

23  5*73436436  6 


25  5.79487936  5 

26  1*39082986  .5 


27  2.67049976  4 


31  1*00000006  0 


i  E 

0 

22 

1 *86614216 

16 

43 

9.12953176  IS 

i  E 

0 

23 

3*47113476 

16 

44 

4*24406608  19 

2  9.30000006  1 


■VJ  iT.VJKJt  13 


9*34081 57E  1  1 
2*25621606  12 


8**3282268  12 
3 • 0078S7 1 E  13 


9 

2 


7  #5696746E  14 
l*88709e3E  15 


4*3590252E  15 
9*3503265E  15 


24  6*0261 1 34E  16 


45  1.83174566  IS 


1  5.3693306E 

8 

30 

4*1 053458E 

17 

51 

2*1 3434236  12 

>  3.64519276 

9 

31 

4*51 1 1 079E 

17 

52 

5.02009196  11 

2*16496486 

10 

32 

4 • 65H0090E 

17 

1 • 1 378094E 

1  1 

33 

4*  5024307E 

17 

34  4*08952266  17 


tiraei»IH=i 


1*06155858  11 


55  3*33596108  9 


36  2*78599916  17 

37  2*08794916  17 


39  9*63945036  16 


42  1 *8269 I OOE  16 


57  6*06141 69E  7 

58 


5 

3 


1  *65999998  3 


63  1 *00000008  0 
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1 

aid 

1 

A(l) 

i 

M(  i  ) 

N 

0 

■  127 

0.  E 

0 

43 

5*1 322422E 

33 

66 

2.5068906b 

33 

1 

0#  E 

0 

44 

1.0020557b 

34 

87 

1 « 1949864E 

33 

2 

1 .8900000E 

2 

45 

1 ♦ 8893005E 

34 

88 

5 .4934755b 

32 

3 

1 .0478999E 

4 

46 

3.4410860E 

34 

89 

2.4342988b 

32 

4 

im 

5 

47 

34  _ 

1 .0392342^ 

32  ........ 

5 

1.1 8351 78E 

7 

48 

1 *0304493E 

3b 

91 

4  .271  88  72c. 

31 

6 

2 .9079643E1 

8 

49 

1 • 6952360E 

35 

92 

1  .6897762b 

31 

7 

3*546372 1 £ 

9 

50 

2*69743126 

35 

93 

6.4277472c 

30 

8 

9*358338 1 E 

.10 

51 

4*1 5246b) E 

35  __ 

94 

ElSEErcIVP 

30 

9 

1 *374 74 58E 

12 

52 

6* 1 8568 1 Ot 

35 

95 

6 •247ti676b 

29 

10 

1 *7842929E 

13 

53 

6.9184543b 

ESI 

96 

2.7779318b 

29 

11 

2 • 0702452E 

14 

54 

1 .2447877b 

36 

97 

6.9694439b 

26 

12 

2*1 678964E 

15 

55 

1 • 6822080E 

36 

96 

2.7737637b 

26. 

13 

2 • 065 1 840b 

16 

56 

2.201 4555E 

36 

99 

6.2072324b 

27 

14 

1 *801 6995E 

17 

57 

2.790265 2E 

36  . 

100 

2.321 0036E 

27 

15 

1  .44771 79E 

18 

50 

3.4256150E 

36 

101 

6 .26609062 

26 

16 

1 .0767087E 

19 

59 

4.0741 206E 

36 

102 

\ .61 28960E 

26 

17 

-  7 .4436275E 

19 

60 

4. 6942821 E 

36 

103 

3 .9528030E 

25 

18 

4*80 1 4877E 

20 

61 

5  *  2405285E 

36 

104 

9.2095567E 

24 

19 

2.0 994527E 

21 

62 

5.66Q5934E 

36 

105 

2.03634 2 7E 

24 

20 

1  .6439586E 

22 

63 

5.9413712b 

36 

106 

4.2666591b 

23 

21 

0 . 775084 1 E 

22 

64 

6.0341936b 

36 

107 

8.452Q714C 

22 

22 

4.4201073E 

23 

65 

5*  9384926E 

36 

108 

1 .5796699b 

.22  * 

23 

2.1055785E 

24 

66 

5.6630976b 

36 

109 

2.7768484b 

21 

24 

9.50422 1 6E 

24 

67 

5*  2329003E 

36 

1  10 

4  »  58654 1 9E 

20 

25 

4.0723190E 

25 

66 

4.6851 578b 

36 

1  1  1 

7.0908030E 

19 

26 

1 .6590295E 

26 

69 

4.0642031b 

36 

1  12 

1 .0220153d 

19 

27 

6 .4  357836E 

26 

70 

3*41 55840E 

36 

1  13 

28 

2 .38055986 

27 

71 

2.7807052E 

36 

1  14 

■Hi  1 

29 

8.4068946E 

27 

72 

2*1 928059E 

36 

1  15 

1 .9333626 b 

16 

30 

2.8377697E 

28 

73 

1 .6747433b 

36 

1  16 

2.01 7291 6E 

15 

31 

9.1 658343E 

28 

74 

1 .2386232b 

36 

117 

1 .91280822 

14 

32 

2  «8356S88E 

29 

75 

8 • 86963 1 3E 

35 

1  18 

1 .6347606E 

13 

33 

8.41 057 1 8E 

29 

76 

6.  1485381b 

35 

1  19 

1 .24676262 

12 

34 

2.3936507E 

30 

77 

4. 1252912E 

35 

120 

8.38100282 

10 

3E> 

6.5419528E 

30 

78 

2  «  6783 1 69E 

35 

121 

4.88838212 

9 

36 

1 *71 8261 9E 

31 

79 

1 *6822607E 

35 

1  22 

2.42396562 

8 

37 

4.340 1 87 1 E 

31 

00 

1  *021 9721 E 

35 

123 

9.9336083E 

6 

38 

1 . 0549Q44E 

32 

81 

6  *  0031 642E 

34 

124 

3.2289597E 

5 

39 

2.4692474E 

32 

82 

3*  4006933E 

7.81 19997E 

3 

40 

5.5681260E 

32 

63 

1 .8703507E 

l .27000002 

2 

41 

1 *21 034 1 3E 

33 

84 

9 *91 36964 E 

33 

127 

1 .00000002 

0 

42 

2  *53731 43E 

33 

85 

3*  0741 606E 

33 

N 

*  255 

0 

O'*  E 

mm | 

UH 

20 

2.11281902' 

28 

1 

0.  E 

EH 

BH 

21 

2.47691 18E 

29 

2 

3  *8099999E 

2 

12 

6*1 3958S3E 

16 

22 

2.73426412 

30 

3 

4.2798996E 

4 

13 

1  (2338827E 

20 

,23 

2.91 1 481 2E 

31 

4 

3*34975 1 6E 

6 

U 

2.2888621 E 

21 

.  24 

2.931 6804E 

32 

5 

2*01 76307E 

8 

15 

S.9225366E 

22 

25 

2*81 72 1 05E 

33 

6 

9.8078245E 

9 

16 

6*251 4522E 

|K£1 

2.5879850E 

34 

7 

1  1 

17 

9* 3036731 E 

H 

2.27627892 

35 

6 

1 .3903531 E 

13 

16 

1  * 2987585E 

26 

28 

36 

9 

4.2395332E 

14 

19 

1  i  7052 775E 

27 

i  29 

1 *33449482 

37 

31  9 • 06b 1  405E  38 

_32 _ 6 .5445957E  39 

33  4*556561  IE  40 

34  3 ♦ 06266 1 0E  41 

35  1 *98909Q3E  42 


2*551 75Q4E  45 
1*41 23949E  46 


7 • 5870889E  46 
3.9578368E  47 


2 • 00609Q8E  48 
9 #8854057E  48 


4 • 73Q 1 5 1 1 E  49 
2*21 00882E  50 


1 • 0036924E  51 
4 *4 399375E  51 


1 *91 39225E  52 
8 • 0430552E  52 


3 • 2963797E  53 
1*31 80623E  54 


5*1 436738E  54 
1 *959744 1 E  55 


7 *292 1 824E  55 
2*6506538£  56 
"974  1  708776  56 
3 *2 702226E  57 


1 *1 104276E  58 
3 • 6878497E  50 


1*1 9Q2270E  59 
3*8097619E  59 
1 • 1 B56423E  60 
3*61 25006E  60 


1  *  0778494E  61 
3.1499109E  61 


9*018 1 81 8E  61 
2 • 5299256E  62 


6 • 955Q280E  62 
1 *8746651 E  63 


4 • 9534854E  63 
1 *28347 1 6E  64 


3*261 5423E  64 
8  « 1 300257E  64 


1 *9882054E  65 
4  *  770B636E  65 


1*1 234736E  66 
2*59669228  66 


5 • 89 1 5462E  66 
1  *312341  IE  67 


2*87O3O60E  67 
6*1 649237E  67 


1 *30045908  68 
2.6945435E  60 


5 • 4845586E  68 
1  *0967628E  69 


88  4. 1608024b  69 

j89 _ 7  •  69506748  69 

90  I *4723806E  70 

91  2  * 6990372E  70 

92  4 • 86362 1 98  70 

93  8 


ram® 


4 • 3280337E  71 
7*1 6754 115 


1*1 673743E  72 
1*86990978  72 


2 *94 6354 7E  72 
4 • 5664 002E  72 


6*  961 9583E  72 
1 • 044 1 949E  73 


1 • 54060488  73 
2*2369263E  73 


3*1 953234E  73 
4*491 14578  73 


6*21 151715  73 
8 *  45365068  73 


1 • 1 322567E  74 
1*49239858  74 


1 *93592978  74 
2*471 57298  74 
3*1  056304b.  74 
*  3*  8*088288  74 


4*67550858  74 
5*60213798  74 


6*60717358  74 
7 *  6704965E  74 
8 • 76567 05E  74 
9*86070308  74 


1 • 091 9380E  75 
1* 19031 24E  75 


1*2773250E  ?5 
‘ 1 • 3493454E  75 


1 *4 032305E  75 
1 *4365513E  75 


1  *  4477740E  75 
l • 4363766E  75 


145  l*4tiy2oldt  74 

-  L46 _ 1__*JL297_3  LL5_Z4__ 

147  8  *43390628  73 

149  4  *479378 1 1  73 


1 • 04090 1 OE  73 
*93904 


4 • 5507427E  72 
2.93584208  72 


1*86305468  72 
1*16287918  72 


7.13891088  71 
4*31011688  71 


2*55903278  71 
V* 494 03648  71 


8*57655248  70 
4 • 84057298  70 


2*68582868  70 
1*46494418  70 


7.8539355E  69 
4*13845358  69 


2*14305248  69 
1 *09050958  69 
5  *452 3o038  68 
670261 68  68 


1*29237368  63 
6>1254986E  67 


2  «•  85 1  431  BE  67 
1*30346948  67 
5 • 3506 1 298  66 
2*57815468  66 


1 *1 1 5234 1 E  66 
4 *73492578  65 


1.97282S3E  6b 
8.0654503E  64 


3*23494638  64 
I *2727280E  64 


4*91 0926 1 E  63 
l • 858 1 343E 


1 *091 1 400E  75 


9*85228848  74 


8*7571 1448  74 
7 • 6620655E  74 


6* 5990953E  74 
5*59459478  74 


4 *66863138  74 


3*8347535E  74 


3* 1 002846E  74 
2 *4670068E  74 


1*06703438  61 
3*57530578  60 


1*1731 1 558  60 
3 • 7&B4564E  59 


1*1 8489378  59 
3*6457379E  58 


1  •  0974  1 30E  38 
3*23097988  57 


9*30078228  36 


-23C- 


I 

At  I  ) 

I 

A  (  1) 

1 

«(l) 

2  01 

7*  1  972309E 

55 

220 

1  .2209736E  43 

238_ 

1^23533705  26 

202 

1 .93353695 

bb 

221 

1  .9424  180E  42 

239 

8.8236B09E  24 

203 

5.0730177E 

54 

222 

2.9Q82747E  41 

240 

5.9069637E  23 

204 

1 .2994600E 

54 

22  3 

4.441 9402E  40 

24  1 

3.691 7886E  22 

205 

3.24857465 

53 

224 

6.3739573E  39 

24  2 

2.1445708E  21 

206 

7 . 9231 659E 

52 

22  5 

8.02O9268E  30 

243 

1 .15202265  20 

207 

1 •8845924E 

52 

226 

1  • 1 76 1 004 E  38 

244 

5 • 6889046E  18 

2  08 

4 • 3699679E 

51 

227 

1 .5091260E  37 

24b 

2 . 5646273b  17 

209 

9.8742203E 

50 

228 

1 .861 4412E  36 

246 

1.0467692c.  16 

210 

2*1 732238 E 

50 

229 

2.2042961 E  35 

247 

3.B295809C.  14 

21  1 

4.6568034E 

49 

230 

2.5026468E  34 

240_ 

1  *.24032985  13 

212 

9.7106528E 

48 

231 

2.7202172E  33 

249 

3.3008743c.  11 

213 

1  *  9695700E 

40 

232 

2.8261470E  32 

_  250. 

,8*43572265  _  9  _ 

214 

3  * 8835740E 

47 

2  33 

2 .80 1731 9E  31 

251 

1 • 687 1 1 73t  b 

215 

7.4403308E 

46 

234 

2.6453637E  30  _ 

^  252 

2 .6883357b  6 

216 

1  • 3842 l 78E 

46 

235 

2  •  3740005b.  29 

253 

3.2003999E  4 

21  ? 

2.4992289E 

45 

236 

2.0203896E  28 

254 

2 . 55000605  2 

218 

4*37643746 

44 

237 

1.6265558E  27 

255 

1 . OOOOOOOE  0 

219 

7.4277433E 

43 

N 

*  51  1 

0 

0*  E 

0 

36 

I.7475956E  54 

72 

1 • 2334938E  88 

1 

0.  E 

0 

37 

2.3041 678E  55 

73 

7.51 9471 6E  88 

2 

7.6499999E 

2 

30 

2.9497778E  56 

74 

3 

1 .7297498E 

5 

39 

3 • 6692703E  57 

75 

l-9^r  1«MH 

4 

2  »  73761  17E 

7 

40 

4.4379869E  58 

76 

1.5460373E  91 

5 

3.33091 34E 

9 

41 

5.2226148E  59 

77 

0 . 8509792E  91 

6 

3.2771594E 

1  1 

42 

5.9835006E  60 

70 

4.99242045  92 

7 

2.701 8898E 

13 

43 

6.6779550E  61 

79 

2 • 7709884E  93 

8 

1 .91491 17E 

15 

44 

7 . 2643386E  62 

60 

1 .51503745  94 

9 

1 • 1 891 1 06E 

1  7 

45 

7.70628985  63 

81 

8.16101775  94 

* 

10 

6.5661520E 

18 

46 

7.9765126E  64 

82 

4.3317464E  95 

1  1 

3.2  624064E 

20 

47 

8 . 0595562E  65 

83 

2.26591325  96 

12 

1 .4725954E 

22 

48 

7 *9E  32081 E  66 

84 

1.168.28095  97 

13 

6  *0872431 E 

23 

49 

7.66'3  3305E  67 

85 

5.9'^7977«f='  97 

14 

2*31 99633E 

25 

50 

7.2272424E  68 

06 

2.97555145  98 

15 

8.1 991908E 

26 

51 

6. 6609505E  69 

87 

1.4702813E  99 

16 

2 • 70059 1 6E 

28 

52 

6 • 0056900E  70 

88 

7. 164581 7E  99 

17 

0.325991 7E 

29 

_ 53 

5 . 2992852E  71 

89 

3 . 4434485E 1 00 

18 

2.41 19546E 

31 

54 

4.5778088E  72 

90 

1 *63253425101 

19 

6 . 5877420E 

32 

55 

3.87289945  73 

91 

7.63b7083tl01 

20 

1 .701 6057E 

34 

56 

3.20995975  74 

92 

3  •  52375595  1  02 

21 

4.1 6795 1 7E 

35 

57 

2. 60728785  7b 

93 

22 

9.70S0B96E 

36 

58 

2 • 0760634E  76 

94 

7.21  180-272103 

23 

2.1 530913E 

38 

59 

1 *62101045  77 

95 

3.1 9B790 1 E 1 04 

24 

4 .560351 7E 

39 

60 

1 *24151315  78 

96 

1  .4003810210b 

25 

9.2388797E 

40 

61 

9*32952755  78 

97 

6*05395035 105 

26 

1 . 7933762E 

42 

6*88064445  79 

96 

2*58358145106 

27 

3.34Q73BBE 

43 

63 

4  *98 1 6602E  80 

99 

1  *08868365107 

28 

5.9809307E 

44 

64 

3*54164745  81 

100 

4.3302296E107 

29 

1  «  030481 4E 

46 

65 

2.4730327E  82 

101 

1 *86174145108 

30 

1  . 7 1 08245E 

47 

66 

1 • 69649065  83 

102 

7*55683645108 

. . "* 

31 

2 .740 162  IE 

46 

67 

1*14359055  84 

103 

3*02985695109 

32 

4 . 2  386603E 

49 

66 

7.5767789E  64 

104 

1  *2000651 5  UO 

33 

6 .33693736 

50 

69 

4 * 9350097E  05 

.  105 

ft 

34 

9. 1 738966E 

51 

70 

3*1 606207E  86 

106 

■11  II  II  III1B 

35 

1 .285991  IE 

53 

71 

107 

6  *9364229E1 1  1 

9.7710332E1 12 

_ 3  • 603 3302E1 1 3 

1 • 3 1 34707E 1 14 
_4jl732850  LLEJUIJl. 
1 • 6859455E 1 15 
5 *93765 1 2E 1 15 


2 • 0676042E 1 16 
7.1 192202E1 16 


1 • 0 1 40 J04E 1 36 
2#.1.074i^^US. 
4 * 340B656E 1 35 
8..8^289_7£.lJiL 
1 *79337 1 5E 1 39 
3 *597 1690c 139 


7*15202362139 
1 • 409566BE 140 


1 *6490b7btl5Q 
29121  JfcJLS.O. 
2*7286bl2blb0 
JL*„4j6b3bO.UtX50_ 
4*3737200dlb0 
5*471 661  bulb 


6  •  79  1  6Vb3c  1  sO 
8. 3634 173d 150 


2 • 9976739E 120 
9.45546 09 E 120 


2  •  9508296E 1 2 1 


1  *2760 1 40E 1 42 
2*3463762E142 


4 • 277794 l E 1 42 


2 • 8786 1 47E 151 


3  *  B 1 72907E 151 


2.7  83922 9E 122 
8.417015BE122 
2*51 83773E 1 23 


l • 38592992 143 
2.4  6296632 1 4  3 
4.3400204E143 


241  4 • 905351 5E 151 

243  6.1 0856 1 5E 151 


1  30 

7 • 45707B0E 123 

187 

7*  5831 517E143 

244 

6 . 73690 09E 1 5 1 

131 

2*1 8536982 124 

1  68 

1 .31 38349E 144 

245 

7 . 371 8 1 36E 151 

1  32 

6  *3366764t 124 

1  G9 

2.2572170E144 

246 

8 . 00365 ObE  151 

,  1  33 

1 .8199226E125 

1  90 

3.8455221E144 

247 

. 8*621 5694 E 151 

1  34 

5.1721233E125 

191 

6 • 49672  99 E 1 44 

248 

9*21 4  0O64E 151 

1  35 

l *4550621 E 126 

1  92 

1 • 0884276E l 45 

249 

9 • 77 1 995 7E 151 

1  36 

4 .0523979E 126 

193 

i *00852868145 

250 

l • 028201 5E 1 52 

1  37 

1  *1  1 73293E  127 

2*9794468£l4b 

■rag 

1 • 0 73 4 2b 3 E 152 

1  38 

3*0500673E 127 

4.86834928145 

1*11 1BV71L152 

1  39 

8*2435949E127 

1  96 

7 .8890  1  t>3c  14b 

2b  J 

1  •  142  7654c.  Ib2 

140 

2*2  Q60866E 128 

197 

1 .2678448E146 

254 

1 *1653314215 2 

141 

5 • 84 5 6350 E 120 

198 

2*0207772E146 

25b 

1 *17907702152 

142 

l .5339372E129 

1  99 

3* 19438002146 

256 

1*1  826628c  1  ocL 

143 

3 • 985 86 QBE  1 29 

200 

5*00014862146 

257 

1 .17904  1  It.  lb*l 

1  44 

i • 0256875E 130 

201 

7.70747B3E146 

258 

1  • 1652604E152  - 

1  45 

2!  •  6 1  39542E  1  30 

202 

1 *20102438147 

259 

1 • 1426b06clb2 

l  46 

6.5976707E130 

203 

1 *8371 6582 147 

260 

-1*111 761 6E 1 52 

147 

1 .649341 1  El  31 

204 

2 • 7 0 73 566 E 1 4  7 

261 

1 *073261 8E 1 52 

1  48 

4 . 0838960E 1 3 1 

205 

4* 1 945986E 147 

262 

1  *  0200 1 35b 1 52 

1  49 

1  *00 1 61 30E 1 32 

206 

6.261 0579E147 

263 

9.76991 1 1E151 

1  50 

2 • 4333407E 1 32 

207 

9.2697959E1 47 

264 

9.2125b93tl51 

151 

5 • 8 55 982 6 E 132 

200 

1 *36132985148 

265 

8*61 92034b 1 b 1 

152  1 *396067BE133 


3#2971504E133 
7* 71 45751 E 133 
V.7883042E134 
4*1 07 1 61 6E 1 34 
9 • 3460455E 1 34 
2  *  1 0724 03E 1 35 
4*707761 5E 135 
1 *042 1 806E 1 36 


209  1 *9630454 E 1 48 


266  6*001 1 0962151 


5*8391 550E148 
8 • 2352 2 98 E 148 


1  • 1521336E149 
1  >  59B9546E 1 49 


2*201 3042E 149 
3  *  00634 68E 149 


6*  10613725151 


4*9031 032E151 
_4 • 342 1 729 E 151 


3*81 53 1 39E 151 
3*  326 1 267E 151 


161  2 *2B61953E 136  210  4 • 073029 1 E 1 49  275  2*8769402^1 b 1 


I *2376757E 151 

_ 1  •0209870 E_4_5 1_ 

8.3567282EI50 

_ 6  •  786052BE J  _50_ 

5 • 467 1 408E I  50 
7E1 5Q_ 


3*4651 392E l 50 


2. 1276136E150 
l *64740326 1 50 
1 • 2654643E 1 50 
9 • 6435955c 149 


7 • 2 906052 E 149 
5  •  4678896E 149 


4 • 0662 1 20E 149 
3 * 002 6934 E 149 


2 • 1 985572E 1 49 
1  *  5 969066 E 1 49 


1  •lS06202EiH9 
0*2241 398E 148 


5*631 0979E  140 
4*101 16O2E140 


2*861 2432E 146 
1 *9601 102E148 


1 *359266*6148 
9  *2  554485E 147 


6.251  1. 54  1  E  1  47 
4 • 1 8762 02 E 1 47 


2 • 7827566E 1 47 
1 *8340704£ 147 


1 • 1 98959 1 E 1 47 
7  »  7738 1 59E 146 


4  *999 1 872E 146 
3*1 8855 1 5E 146 


2*01 70 1 BSE 146 
1  *26544 1 5E 146 


7 • 0737795E 145 
4  *85077 1 2E 1 45 


2.9734772E145 
1  • 8046396E 145 


1  • 086 1 676E 145 
6  *  4829998E 144 


3 • 8372526E 144 
2 • 2522 78 7E 144 


1 *31091 13E144 
7  *  56599 1 0E 143 


4 • 3 30 0340 E 143 
2  *4 572049E 143 


b • 3 1 B65536 140 
Z *7462 0976 14£_ 
1 *40559226140 

3*58672256139 


8*83579256138 


Pi* 


2*1 0092906138 
)  *0l06733Si.3& 
4*82059866137 
2*27630456137 


1  •  067 1 2026 1 37 
4*95339106136 


2*27854136136 
1 *03864296136 


4*69155956135 

2*09988816135 


9*31298946134 

4*09243626134 


1 *78180526134 
7  *686 1 584 E 1 33 


3*284641 16133 
1 *39078546133 


5.83352776132 
2 • 4 2 3084 9E 1 32 


9*97668846131 

4*06759986131 


1 *64267246131 
6 • 570640 OE 1 30 


2*60310306130 
1 • 02 1 3734E 1 30 


3  *  9688 95 OE 129 
1  • 5273 i 42E 1 29 


5  *82 02634 E 128 
2* 1963100E128 


8*2  06583 1 E 1 27 
3*03619396127 


I • 1 121Q08E127 
4 • 0334806E 1 2 


1  *44818096126 


5* 1 473445E 1 25 


1 *01 109016125 
6*30771096124 


2* 17448536124 
7*41945306123 


2 • 50550496 123 
8*  373 4 32 5E 1 22 


394  8*  1  14*:  7ub61  1  7 

39b  2*4  0.9 JjeJLUL 

396  7*0761 126E1 16 

397  2  »  054  91_8_66_1_1_6_ 

398  5*900736961  lb 


m  i-i 


400  4.702A354E1 14 


— fWttjgygl  I3l  m 


402  3.579704BE1 13 


2*601 1238E1 12 


1 1 


1 .8030bS2El 1 1 
4 • 663C456E 1 1 


1 .1915327E1 10 
3.00B0181E 


7 • 50 1 6 1 4  5E 1 0  8 
•B479477E 108 


4.4961967E107 
1 • 0803905E 107 


2 • 5636235E1 06 
6.0065224E105 


1 .3894525E105 
3*17301 05E 104 


7*1 525490c  103 
1 .591 3475E103 


3*494 1 083E 102 
7 • 5705254E 101 


1 *61 83929E 101 
3*4131 794E100 


7*1 00665 1 E  99 
1*4569680 


430  4.2894274t  95 

40 


1 .5314052E  91 
2.6342B42E  90 


4.4607775E  89 
7.4345906E  8B 


1  *21  93342E-  88 


3.668058BE 1 4 1 
1*943834 2 E 1 4 1 


2*981 1 1 10E120 


9.3494366E1  19 


2.9007035E1 19. 
8.9023570E11B 


1.6748752E  83 
2.4409494E  82 


3.4948542E  81 
4*91461 44E  80 


ao^oc^uiuiuiuiurirtm  m 
^UW-OOtB^tMJl^UIU 


9*1  991 532E 

70 

472 

4«3387268E 

56 

493 

6  •  2704596c. 

32 

! _ 1  •22382e_l_E_ 

J78 _ 

473 

3 • 5849469E 

57 

494 

2  *2894079E  31 

\  l •5974670E 

77 

474 

2 •8800732E 

56 

495 

7  *07649556 

29 

>  2 •0453 1 20E 

76 

_ 475 _ 2  •2401  464E 

55 

_  496 

_2jl54  6574.0  6L 

28  _ 

i  2 * 5678903E 

75 

476 

1 •7038523E 

54 

497 

7 • 70 1 301 8E 

26 

»nrm™ 

74 

53 

■ Km 

25 _ 

'  3*811 9467C 

73 

478 

8 * 9299655E 

51 

499 

5*66299686 

23 

72 

Em 

■r>r-iiKfZT3 

22 

»  5*21 231 48E 

71 

480 

4*1 I85706E 

49 

501 

2.996030SE 

20 

1  5.9049912E 

70 

481 

rrremzsn 

48 

18 

6  *S468072£ 

69 

482 

1  • 6589734E 

47 

503 

1  *072121  IE 

17 

7*1 006257E 

68 

HKx3*1 

■TvTTFkF+i^ 

T45_ 

■KTnrTTm 

15 

1  7*530931 3E 

67 

484 

5 • 7862550E 

44 

505 

2*36626336 

13 

7.8074092E 

66 

485 

3 • 2278560E 

43 

HIET79 

1  1 

i  7.9083306E 

65 

486 

1 • 7303896E 

42 

507 

2*  7803922E 

9 

r-T*j 


23k- 


ERBOR  RATE  EQUATION  COEFFICIENTS 


HAMMING  SINGLE  ERROR  CORRECTING 
/DOUBLE  ERROR  DETECTING  CODES _ 


££ TECTION  WITHOUT  CORRECTION  OCCURS  IF  CHECK  WORD  IS  NON-ZERO  ANU 
OVERALL  PARITY  CHECK  IS  SATISFIED. 


o(r> 


ijl 


1 • 50277226  13  3.54541 14E  15 


2.6440638E  15  0.  E  0 

_9  .  ,57994  Me-JLa _ L*.93J3i^Le_L6_ 

1.J709352E  16  0 •  E  0 

_4._3 15 534  9E  14  7.9091995E  16 

5 • 3372  767E  16  0*  E  0 

• 4686466E  15  2*4673263 


8*23874845  14  7*90919955 


2  •  739863 1 E  16  0#  5  0 

75875.5 _ L4 _ 1.  •_93J3  Ub  1.5_I6_ 

6  •  0758 1 1 7E  15  0.  u  0 

4*04486225  13  3*54541145  15 

1.00287195  15  0*  E  0 


1  27 

3.5924 182E 

17 

0.  E 

0 

51 

1  . 0346558E  13 

0.  5 

1  28 

7.647841 0E 

1  5 

1 .101 2890E 

18 

52 

4 . 1 694847E  10 

3.23289735  J 

34  1 


9*1  544397E  17 
1  • 3449650E  16 


0  •  E 

1 .5949704E 


58  1 


5.4567853E 
1 .05722JUE 


0*  E 

7.38677675' 


236 


I 

Ail) 

B  (  1) 

I 

A  (  I) 

. . J*UJ _ 

♦ 

6a 

8.5184579E 

34 

2.2334847E 

37 

96 

d *65902048 

27 

1 *466261  IE 

30 

63 

1 . 1609964E 

37 

0.  e 

0 

97 

3 *67487628 

29 

0*  £ 

0 

64 

9*35591028 

34 

2  *376401 2E 

37 

98 

9  *22438608 

26 

1*53011856 

29 

65 

1  *  1 972686E 

37 

0*  E 

0 

99 

3.5944B70E 

26 

0.  E 

0 

66 

9*06603608 

34 

2 • 2334847E 

37 

100 

8.2717134E 

25 

1 .3446496E 

26 

67 

1  .0895997E 

37 

0*  E 

0 

101 

2.9476126E 

27 

0*  E 

0 

68 

7*75561 14E 

34 

1 *8540473E 

37 

102_ 

— 84-_ 

26 

69 

8  *7493608E 

36 

0.  E 

0 

103 

2*0081 77  2  E 

26 

0*  E 

0 

70 

5*85 1 4804E 

34 

1 *3588670E 

37 

23_ 

5.9875923E 

25 

71 

6*1 962892E 

36 

m 

105 

1 • 12461 00E 

in 

0*  E 

0 

7a 

3*8923 l 32E 

34 

22 

24 _ 

73 

3 • 8675492E 

36 

0*  E 

0 

107 

5 • 1 1 18663E 

23 

0.  E 

0 

74 

-34_ 

.36- 

wrm 

rennrm 

23 

75 

2*1 2558638 

36 

0*  E 

0 

109 

1 .8S75748E 

22 

0*  E 

0 

76 

1 . 1761962E 

34 

2*51 58220E 

36 

__  110 

2  •  546*09 1  6E 

J9 

21 

77 

1 *0273829E 

36 

0*  E 

0 

111 

3.2976223E 

20 

0 

78 

5 • 3302675E 

33 

1.11 08824E 

36 

112 

6 • 3808666E 

17 

_9*  26i  3750E 

1  9  _ 

79 

4.3605776E 

35 

0*  E 

0 

1  13 

1 • 1588818E 

19 

0.  £ 

0 

80 

2*1 193047E 

33 

4 • 3064273E 

35 

1  14 

1 .21002866 

1*6 

1 *7254542£ 

1  8 

81 

1 *62226858 

35 

0*  E 

0 

1  15 

1 .8808952E 

17 

0*  £ 

0 

sa 

7  *3783206E 

32 

1 *4627070E 

35 

1  16 

1 •6798228E 

14 

2*  3540680E 

16 

83 

5.2790442E 

34 

0.  E 

0 

117 

2.2083725E 

15 

0 

84 

2.2440675E 

32 

4.3428050E 

34 

1  16 

1 .6337723E 

12 

14 

85 

1 *4907B56E 

34 

0*  E 

0 

1  19 

1 • 7594363E 

13 

nmmmm 

0 

86 

S.9464650E 

31 

1  • 124020 1 E 

34 

120 

1 • 0472044E 

1  0 

1  .41853226 

12 

87 

3*70 1 8770E 

33 

0.  E 

0 

121 

8.869861  IE 

10 

0.  E 

0 

88 

1 . 3685930E 

31 

2.528164SE 

33 

122 

4.0346372E 

5* 3812796b 

9 

89 

7. J277742E 

32 

0.  E 

0 

123 

2 .523301 7E 

8 

*0*  E 

0 

90 

2 • 7260025E 

30 

4*9237662E 

32 

124 

6 .26769936 

4 

l .0582655E 

7 

91 

1 .4664229E 

32 

0*  E 

0 

125 

3 • 3070797E 

5 

0  •  £ 

0 

9  a 

4.6798030E 

29 

8.2690 1 03E 

31 

126 

0*  E 

0 

8. 12799986 

3 

93 

2.3325509E 

31 

0*  E 

0 

127 

1 .28000003 

2 

0.  £ 

0 

94 

6  *891 71 56E 

28 

1 • 1918272E 

31 

126 

1 • 0000000E 

0 

0*  £ 

0 

95 

3*1 744498E 

30 

0*  E 

0 

N  «  256 

0 

0.  E 

0 

Id 

• 

o 

0 

21 

2  *688 l 936E 

29 

0*  E 

0 

1 

0*  E 

Q 

o*  e 

0 

22 

1  * 1300992E 

28 

3. 3533137E 

31 

a 

0*  E 

0 

3 • 2639999E 

4 

23 

3*1 869075E 

31 

0.  E 

0 

3 

4.3179997E 

4 

0*  E 

0 

24 

1 .21 76934E 

30 

3*  3121260E 

33 

4 

l • 0794999E 

4 

1  .74101 74E 

8 

25 

3. 1 103785E 

33 

0  •  £ 

0 

5 

2.051 1360E 

8 

0*  E 

0 

26 

1 . 0876437E 

32 

2.7308223E 

35 

6 

3.3732213 E 

7 

3.6709330E 

1  1 

27 

2.5350774E 

35 

0*  E 

0 

7 

4.0849783E 

1  1 

0*  E 

0 

28 

8.1 604264E 

33 

1 .902345 IE 

37 

8 

5  *0008099E 

10 

4.0806335E 

14 

29 

1  . 746467BE 

37 

0*  £ 

0 

9 

4.3785686E 

1  4  ' 

0.  E 

0 

30 

3.20 1 3671 E 

35 

1.13181 74E 

39 

10 

.  4  *2545484E 

13 

.?  .7773698E 

17 

31 

1  .0276223E  39 

0#  E 

0 

1  1 

2.9019893E 

17 

0.  E 

0 

32 

2.8439732E 

37 

5*  601 70S3E 

40 

12 

2.33U063E 

16 

1 *268 1 2 1 8E 

20 

33 

5*21 1 0206E 

40 

0.  E 

0 

13 

1 .2972 78SE 

20 

0.  E 

0 

34 

1  .3452834E 

39 

2  *  58294B0E 

42 

14 

8.8599968E 

18 

4#  1312897E 

22 

35 

2.29S3644E 

42 

0  •  E 

0 

15 

4.1S14229E 

22 

0*  E 

0 

36 

S.S464196E 

40 

1 .00573076 

44 

16 

2.460631  BE 

21 

1  .00393776 

25 

37 

B •8437908E 

43 

0*  E 

0 

17 

9.930820  IE 

24 

0*  E 

0 

38 

2.0062049E 

42 

3.44644876 

45 

18 

S  •  1 B90383E 

23 

1 •861691  IE 

27 

39 

2.99890336  43 

0  *  E 

0 

19 

1 .8331 334E 

27 

0*  E 

0 

40 

6*403881 8E 

43 

1.04511346 

47 

20 

8.538271 3E 

25 

2  *79341 97E 

29 

_ il_ 

8.99948396 

46 

6 

0 

57  1 #206794 1 E  57  0# 

58  1 #62991758  55  1  .8345002E  58 


114  2 • 1 7650688  72 

1  15  6 #9465 1 33E  74 


1.2463365E  75 
•  *  E 


1  .5670127E  59 
1  #9401  105E  57 


1  • 5666 1 86E  60 
1  • 859745 1 E  58 


1  .4390995E  61 
1#6394365E  59 


69  9 

70  9 


73  4 

74  4 


75  2 

76  2 


• 4857537E  62 
•9754578E  60 


.8281 505E  63 
•9065492E  61 


•5450 138E  64 
•4246065E  62 


* 80 1 207QE  65 
•6262232E  63 


2.0427494E  60 


0#  E  C 

1  .8969402E  61 


0.  E  0 

1 #62 1 5523E  62 


0#  E  0 

9.3028268E  63 


0#  E  0 

6.2619379E  64 


0 

3.9032204E  65 


0#  E  0 

2.2557875E  66 


8#1 141027E  72 
2  •2822504E  75 


1  • 07509 1 7E  73 

2  •  83978 1 8E  75 


l # 1266Q96E  73 
2.8841506E  75 


1  •  1 09221 6E  73 
2.7517422E  75 


1.0258508E  73 
2 • 46629 1 2E  75 


4 • 34 1 7099E  75 
0 


5 

0 


'  5#  5699987E  75 

0# 


5.7461170E  75 

0. 


5#5699987c  75 

0.  E  0 


5 • 07329Q6E  73 
0.  E 


I 


B  (  I  ) 


A  Cl) 


156 

2*9265b38E 

70 

1 *2254871 E 

73 

157 

4 • 7966966E 

72 

0*  E 

0 

156 

1 .1837613E 

70 

4 .8908821 E 

72 

159 

1 *876770 1 E 

72 

0.  E 

0 

160 

4.4792754E 

69 

1 *8275443E 

72 

161 

6*6691 495E 

71 

0*  E 

162 

-69- 

163 

2 .351 691 7E 

71 

0*  E 

0 

164 

_68_ 

-71— 

165 

7.526401 SE 

70 

0*  E 

0 

166 

1 .6243005E 

68 

6.3H76106E 

70 

167 

2*25033756 

70 

0*  E 

0 

■mHfn 

-67L 

-,,7Qn  m 

169 

6*28 1 5060E 

69 

0.  E 

0 

170 

1  *2655526E 

67 

4.8597229E 

69 

171 

1 *63574556 

69 

0*  E 

0 

172 

3.1 822844E 

66 

mwmzrm 

69 

173 

3*9706352E 

68 

0*  E 

0 

174 

7.4565080E 

65 

sum 

68- 

175 

8  *97693036 

67 

0*  E 

0 

176 

1 *6264737E 

65 

6.0327392E 

67 

177 

1 .8885 30 7E 

67 

0*  E 

0 

176 

3.2997287E 

64 

1 *21014765 

67 

179 

3.6933887E 

66 

0*  E 

0 

180 

6 • 2200022E 

63 

2*2557875E 

66 

161 

6.707751 0E 

65 

0*  E 

o" 

162 

1 .08821405 

63 

3.9032204E 

65 

163 

1 . 1 300396E 

65 

0*  E 

0 

_  184 

1 • 7650070E 

62 

6*26 1 V379E 

64 

185 

1 *7638205E 

64 

0*  E 

0 

166 

2.6506216E 

61 

9.3026266E 

63 

187 

2 • 5474225E 

63 

0*  E 

0 

186 

3*680784 0E 

60 

1  *2780935E 

63 

169 

3 • 3996553E 

62 

0*  E 

0 

190 

4*71 95902E 

59 

1 *62 1 5523E 

62 

191 

4. 1861436E 

61 

0*  E 

0 

192 

5 • 379235 1 E 

58 

1  .896V402E 

61 

193 

4 .74642 1 2E 

60 

0*  E 

0 

194 

6  *07066856 

57 

2.0427494E 

60 

195 

4 • 953352 1 E 

59 

0*  E 

0 

196 

6.06906565 

56 

2.0213703E 

59 

197 

4.7431509E 

58 

0*  E 

0 

198 

5 . 564201 0E 

55 

1 .834500  IE 

56 

199 

4 *16095796 

57 

0*  E 

0 

200 

4  *6686078E 

54 

1 *5238335E 

57 

201 

3.3369629E 

56 

0*  E 

0 

202 

3.5769435E 

53 

1  •  1SS9547E 

56 

203 

2*44083666 

55 

0  •  E 

0 

204 

2*49651586 

52 

7.988U502E 

54 

205 

1 *62431840 

54 

0«  E 

0 

206 

1 .5831564E 

51 

5  *0 1 691 48E 

53 

207  V.8077582E  52 


200  9.09603V8E  49  2.U547570E  52 

209  5  *357389011  51 


210  4  *7204331 E  40  1.4673802E  51 

2 1 1  2.63BV042E  SO 


212  2*2052 1 25E  47  6. 79039Q2E  49 


216  3.4S80961E  44  1.0451 1J4E  47 


218  1 015092806  43  3*44644872  45 

a i o  aa  o.  e  o 


220  3*38947856  41  1*00575076  44 

221  1*41521536  4 


224  1*99078136  38  5.80170536  40 


rr-4*i 


226  3*91 83633E  36  1.1318174E  39 

227  1 *3270 1 30E  38 


220  6*6449106E  34  1.90254S1E  37 
229  2.081 0708E  36  0 


232  1.1771036E  31  3.3121260E  33 

233  3*1 063202E  32  0 


236  1.0098760E  27  2*79341970  29 

237  2  < 1 830452E  28  0.  E  0 


238  6.861 0615E  24  1.881891  IE  27 

239  1 .323573BE  26  0.  00 


240  3.6909477E  22  1.0039377E  25 


241 _ 6*27614250  23  0 


246  1*04661880  15  2.77736980  17 

247  1  .0850651 E  16  0. _ 0  0 

248  1.55025100  12  4.08063350  14 

249  1.2733386E  13  0. _ c  0 

250  1 .40550880  9  3.67093500  11 

251  8.60443430  90.  £  0 

252  6.B00849SE  S  1 .74101740  8 

253  2.72033970  6  0. E  'b 

254  0.  E  0  3.26399990  4 

255  2.S600000E  2  0. E  0 

256  1.00000000  0  0.  0  0 


£  0 


[ 

F  _ 

I  '  _ I  _ Ad) _ U(l) 


N  ■  512 


y, 

1 

_v 

0 

_ c_ 

.  £ 

0 

— V. 

0 

.  ^ 

•  £ 

0 

2 

0 

.  £ 

0 

1 

.308 1 599E 

5 

3 

1 

• 7373998E 

5 

0 

.  £ 

0 

4 

4 

.3434996E 

4 

.62431715 

_a. 

5 

3 

.3562 B95£ 

"  9 

0 

.  £ 

0 

6 

5 

•  560374  IE 

b 

2 

•424760BE 

13 

7 

2 

• /346614E 

13 

0 

•  £ 

0 

B 

3 

.3831 S74E 

12 

_± 

• 1064266E 

1  7 

9 

1 

.20826975 

17 

0 

•  E 

0 

10 

1 

.1912  Obo£ 

16 

3 

. 1 168830E 

20 

1  1 

3 

•328G680E 

20 

0 

.  £ 

0 

12 

2 

•7235576E 

19 

5 

•93b0b20£ 

23 

1  3 

6 

.2345026£ 

23 

0 

•  £ 

0 

1  4 

4 

• 3ob9463£ 

22 

d 

•  1 4  0 J924E 

JL&. 

i  5 

6 

•  431  1 95 1  £ 

26 

0 

•  £ 

0 

16 

5 

• 1339162E 

.394982o5 

17 

8 

•5960509E 

29 

0 

•  £ 

0 

18 

4 

.6341 159E 

2b 

6 

•7357405E 

32 

19 

6 

•  Q2B9376E 

32 

0 

•  £ 

0 

20 

3 

*  3000060E 

31 

4 

•3169356E 

21 

4 

.3381 1 235 

35 

0 

•  £ 

0 

22 

1 

.69bOo9 IE 

34 

2 

•2572526E 

JiSL 

23 

2 

.25014205 

3b 

0 

•  £ 

0 

24 

b 

•9bdOd9BE 

36 

9 

•7981942E 

40 

25 

9 

•69491 5 l E 

40 

0 

•  £ 

0 

26 

3 

.5601 143E 

39 

3 

•5824606E 

43 

27 

3 

.S2007655 

43 

0 

•  £ 

0 

28 

JL 

.  1  9S3767E 

42 

1 

•  1  1695V9E 

46 

69 

1 

•u9u2907£ 

46 

0 

.  E 

0 

30 

J3 

♦44 1 4464E 

44 

3 

•00131015 

48 

31 

2 

.91  124465 

4b 

0 

•  5 

0 

32 

8 

.6792  71 4E 

46 

7 

•01441225 

50 

33 

6 

.7628054E 

50 

0 

•  £ 

0 

34 

.867941 2E 

49 

■HAMM* 

5J 

35 

1 

•3777299E 

53 

0 

•  £ 

0 

36 

3 

.5790068E 

51 

.60 1 Q63Q£ 

55 

37 

2 

•4789275E 

55 

0 

.  £ 

0 

3B 

6. 

.0751 736E 

53 

4 

.18279035 

57 

39 

3 

.9642S62E 

57 

0 

.  £ 

0 

40 

9 

. 1907324E 

55 

6 

•01 147415 

59 

41 

5 

.66641335 

59 

0 

.  £ 

0 

42 

1 

.24S8S97E 

58 

7 

•  76  0B773E 

61 

43 

7 

.27630635 

61 

’  0 

.  £ 

0 

44 

J_ 

.52062525 

60 

9 

.04191395 

63 

45 

b 

.43572385 

63 

0 

.  £ 

0 

46 

J_ 

.37849385 

62 

9 

•54668B4E 

6b 

47 

e 

•8S7207SE 

65 

0 

•  £ 

0 

46 

1 

.6b22978E 

64 

9 

•16964445 

67 

49 

6 

•4636513E 

67 

0 

•  £ 

0 

50 

1 

•  5366 1  30£* 

66 

8 

.04084275 

69 

51 

7 

.  383674 9E 

69 

0 

.  £ 

0 

52 

1 

.28341535 

68 

6 

•4573559E 

71 

53 

5 

•89985415 

TT" 

0 

.  £ 

0 

54 

9 

.83237645 

69 

4 

.76382276 

73 

56  6.92920965  VI  3.23732675  75 

SB  4 *503956 1  £  73  2. 03170155  77 


2*70659295  75 
1 *05710405  79 
1.50766335  77 
5.66972456  50 
7*79650606  75 
2.52719745  52 
3*75426455  60 
1  •  3 1  3<.‘6  7oc  64 

1  .ob4999oc  62 
t)»Q^^oo7ot:  65 
7«0o36jVoc  o3 
c*jQ63j/3c  dV 

2  »  7  /0  33  ^5E  63 
b  »  7529632c.  bb 
i  .01  bi  Q9>£  b7 

1  1  44360c  90 
3*51 12146E  bb 
1  .Q4QY0ibc  S rd 
1  •  1379649c  90 
3.c/Q2oQ4E  93 
3.4704420E  91 
9.6760332c  94 
9.9717369c  92 
2.6990b79£  96 


2.7027420c  94 
7.1 062 1 B6E  97 


6.917939b£  9b 
1.7676365c  99 


1  .  1 d03496c  79 

_£Ls _ E  o 

6. 3621 333c  bO 

0. _ &  0 

3. loo 17/1 c  32 

0  . _ E  0 

1 *4ob232 1 c  04 

0. _ c.  0 

b«4o30ouJC  os> 

0. _ c  0 

2.o4oi03oC  b7 

_ 9  M„ 

1 .00ooV9oc  b9 

0, _ c  0 

3.bVVdVU3c  90 

0. _ c  0 

1 .2067451 E  92 

0. _ ,  if  0 

3. b l 70262b  93 

0* _ £  Q 

i . 1 349733E  95 

O. _ £  Q 

3.15161 63E  96 

0.  e  o 


6.41614035  97 

0.  £  0 


2.1 046040£  99 
0 


1 .71 0391 4£ 1 0 1 
3.9199403c 


3.33B5363£102 
7 . 454  53 1 4£ 1 05 


6.1 6 94 693 £ 103 
1  •  34704 1 7EI  07 


1 • 090  7969 £ 1 05 
2.314  764 4 £  106 


1  . 626 7664 £  1  Ob 
3  •  76354032  1  09 


2  •  9 1  B  96 1  4  £  1  0  7 
5.696047 i £ 1 1 0 


4 .436  7761 £1  OB 
6.752 04 06£1 1 1 


6.43509032109 

I.2389794E113 


4. 7605651  cl  04 

0.  £  0 


9. 09662972 1 05 

0.  £  0 


1 .6524166b 107 
•  £  O' 


2 . B536739£ 106 

0.  £  0 


4.69063 76£L09 
*0  •  £  0 


7 • 3432590 £1 1 0 

O.  £  0 


1 .095590461 12 
*  £ 


1 .5569125c!  13 

0.  £  0 


-2 


3*1 3596 1 6£ 117 
5 


3*53454 Voci lb 
2  #26966 1  2£  1  16 


3*812628G£1  IV 
2*395836161  1  7 


3*93788076  120 
id  *  422  1  6036  1  lb 


3  *69637566  L  id  1 
id  •  346483  161  IV 


3*695061 56 122 
a-  17917108120 


3  *3600  7006. 123 
1 *94096256121 


2*93107778124 
1  *65880498122 


0*  6  0 
4 *94 6466581 IV 


0*  £  0 
5* 137931 68120 


0*  £  0 
5*11  064548  1  id  1 


0*  8  0 
4*67234318122 


0*  8  0 
4*45422548123 


0  •  6  0 
3.9063316E124 


0*  6  0 
3*26765168125 


8 


3 • 03627766 1 36 
2*97299766141 


1*09706346139 

♦05576006142 


3*62963458139 
3  »  62239036 142 


1 *291 73176140 
1 *20104966143 


4*2107o216140 
3 • 6466962c 143 


1 *61254006142 


5*5664 1 626 1 42 
0* _ 6  0 


1 *65691386143 


5*  9673230c 143 
0 


1 *12936616126 
5*69974526125 


0*  8  O 

1  *10254436129 


196  2  *466697 Ot 143  3*32205506146 

197  2*03674656146 


141 

6*05192166126 

0*  £  0 

196 

6*41574676143 

6  *477602061 46 

142 

4*12480046126 

7*59985766129 

199 

5*2151 5736 146 

0*  6  0 

143 

5*51961798129 

0*  E  0 

200 

1 *60030616144 

2* 0934563c 147 

1  44 

2*77330246127 

b  « 038b VI b£ 1 30 

201 

1 *27956266147 

0*  6  0 

145 

3*63964176130 

0*  6  0 

202 

3*66270696144 

5*00301 1 0 c 1 4  7 

146 

1 *79386616128 

3*21460796131 

203 

3. 0381 90 1 1 1 4  7 

0*  6  0 

147 

2  *3091 082E i 3 1 

0  •  £  0 

204 

9*02326628144 

1 • 1 572453c 1 40 

146 

l *1 1 65900E 129 

1 *97368976132 

205 

6*98195536147 

0*  6  0 

149 

1 .4100026E132 

0*  £  0 

206 

2*04016606145 

2*591 15526146 

150 

6*69042608129 

1 *16695306133 

207 

1 *55306536146 

0*  6  0 

151 

8  •  2693234c.  1  32 

0*  6  0 

206 

4*46532926145 

5*61669716140 

152 

3*86012466130 

6*64429036133 

209 

3* 34437536146 

0*  6  0 

153 

4 *6932 1 026153 

0*  6  0 

210 

9.461 bOl 7b 14b 

1 *17677696149 

154 

2*14517756131 

3*64446178134 

21  1 

6. 9783628 E 1 48 

0*  6  0 

155 

2*05976166134* 

0*  £  0 

2 12 

1 .941 0278E1 46 

2*39544796149 

156 

1  *14656216132 

1  *92631 V4£ 135 

213 

1 . 4074386E 149 

0  •  8  0 

157 

1  •  34532076 135 

0*  £0 

214 

3*65574666146 

4.7139b>>0fel49 

158 

5  •  92674378 1 32 

9  *81 406 70 £1 35 

215 

2 • 75 1 066481 49 

o.  to 

1  59 

6.81 506l VEi 3b 

0.  E  0 

216 

7.41701 bbEl 46 

6*  9839287c 1 4V 

160 

2 .9480842E 133 

4 .82 07072 El  36 

217 

5 .207651 0E1 49 

0*  £  0 

161 

3*32637608136 

0.  E  0 

216 

1 .381 V497E147 

1 • 65830296 1 50 

162 

1 *41398168134 

2.283S979E157 

219 

9 . 6472 1 bVE 1 49 

0*  £  0 

163 

1 *56759418137 

o.  to 

220 

2.493 1 234E1 47 

2<  V649137E 1 bO 

164 

6*54065658134 

1 .0434740E 136 

221 

1 *69b2842ElS0 

0.  £  0 

\B 


4 


I 


l 

I 

1 

I 

I 

I 

I 

l 


-241- 


I 

AC  1) 

dll) 

1 

A  (  1  ) 

8(1) 

^4 

7 #0/630636 147 

o*61 560032 1 30 

281 

2  •  230 3o2 7 li  1  3 1 

0*  2  0 

223 

226 

4 • oud3  7242 1 30 

1 #20972446146 

0*  2  0 

1 *40043432131 

282 

283 

3*62  7 394 o2 148 

1  *3142781(1131 

j*  ooa5Ua©tl  til 

0.  ©  0 

227 

228 

7*642071  161.30 

1 #92204^65148 

0.  £  0 
2*20336142131 

284 

28^ 

2*394 1 2332 1 4b 

9 • 83694932 130 

2  *20336142 1 31 

0.  2  0 

*2* 

230 

1  .22635©0t  1  5  1 
2. *5867636 148 

0.  2  0 
3.36308522151 

266 

287 

1 .33089012148 
6.191 17712150 

1 • 4004543© 1 5 1 

0.  to 

c3i 

232 

1 *8361 1 406131 
4*41 278792 146 

0*  2  0 
4*97640672151 

208 

269 

9.48390212147 

3.77301702150 

8*61360052150 

0*  .....  2  0 

2  33 
234 

2 • 72  76  3076 131 
6*37721932146 

0*  to 

7. 13027846161 

290 

291 

3.69179992147 

2*22982382150 

5* l 350*34© 1 50 

0.  to 

236 

236 

3 • 88044668 131 
8*93042682148 

0.  2  0 

9 • 90 0364 4 E 1 b 1 

292 

293  i 

3*30903472147 

1 .273849721^0 

2.96491372180 

0*  c.  0 

237 

238 

5  •  34903372 1  5l' 

1 *21 166322149 

0*  2  0 

1 *33219452132 

294  ' 

295 

1 .86346072147 
7*070^0352149 

l *63830292130 

0.  2  0 

239 

240 

7*14523842131 

1 *39364642149 

0  *  E  0 

1 .7372875E 132 

296 

297 

1 *01 6403621 47 
3*79546402149 

8* 98392872149 

0*  *  2  0 

24  1 

242 

9*24964932131 
2*0 3096232149 

0.  E  0 

2. 19372262152 

298 

299 

5*3692201 2146 

1  *973  0342c.  1’4  9 

4*7139^902149 

0 .  2  0 

243 

244 

1 . 1 604089© 1 ©2 

2 • 5083968E 149 

0*  2  0 
2*68966002152 

300 

301 

2  •  7 4  6  7  3  7  4  2  1  4  6 

9  •  93  22  360 ci  148 

2 • 3934479c 149 

0*  c  0 

246 

246 

1*41087142132 

3  *002o2342149 

0*  2  0 

3. 19331832132 

302 

303 

1  *  360634 On  1 46 
4*841 5w032 1 48 

1  •  1787769c  Uv 

0*  2  0 

247 

248 

l .66251202152 

3 • 4832  6  742 149 

0.  2  0 
3*6746934213 2 

304 

303 

6*3262.j04l.14*j 

2*8o4bl36214b 

3*61 6697 1214o 

0  #  c  0 

249 

250 

1 •69860032132 
3*91643102149 

0*  2  0 
4.09865562132 

306 

307 

3*03030 762143 

1 .04389742148 

2 • 59 1 1 33c2 1 46 

0*  2  0 

251 

252 

2*101  6c6bc  1  52 

4 • 267942 12149 

0  #  2  0 
4.43107342132 

30b 

309 

1 *06233932143 
4*61662/1 2147 

'1  * 13V24b3214u 

0*  2  0 

253 

234 

2*23466222132 

4  #30766 162 149 

0*  2  0 

4  *64331 1 32132 

310 
31  1 

5*92791 962144 

1 *97634062147 

3*00301 102147 

0.  2  0 

255 

256 

2*34440842 1 52 
4*61476392149 

0.  E  0 

4 .7162899E152 

312 

313 

2  •  4 9 6 4  7  7 u2  1  4  4 
o  *  1  o  7  7  3  6  7 c  1  4  6 

2 • 0934 3o3c 147 

0*  c  0 

237 

23d 

2 • 362  72392 1 o2 

4  *3  /603 165149 

0.  2  0 
4.64331 132152 

314 

315 

1 .01 744702144 

3  *282460021 46 

6*47760203 146 

0*  2  0 

239 

260 

2*30792136132 

4 • 4034 J2dc 1 4  9 

0  *  2  0 

4  .43  107348  132 

3  1  o 

31  7 

4*01  23691  cl  43 

1  *87323b>Qcl46 

3*32203492 1 4a 

0*  2  0 

261 

262 

2*1 oqO^ool 1 52 

4 • 1 044 1 572 1 49 

0*  2  0 

4 .09865362132 

318 

319 

1 .330901 921 43 
4*7/81 1 712145 

1 *23933732146 

0*  2  0 

263 

264 

2*O«j50w4O2  132 
3.707931 72149 

0*  2  0 

3*67469352132 

320 

321 

5*6305229214 2 

1 *73446762145 

4*61 98674  2143 

0*  2  0 

265 

266 

1 *78317632132 
3*24663102149 

0 .  ©  0 

3*1 9331 85 E 1 68 

322 

323 

2.0172B94E142 
6*  00953 1 3© 1 44 

l .63y0yl6©146 

0.  ©  0 

267 

268 

1 *53704492152 
2*7551 2442149 

0.  E  0 

. 2.6896600E152 

324 

325 

6.9650664E141 
2*06751 05c  J 44 

5*62433392144 

0*  2  0 

269 

270 

1 . 26403712152* 
2*26594972149 

0*  E  0 

2* 1957226E132 

326 

327 

2*32539292141 

6*78723902143 

1 #86624902144 

0  •  2*0 

271 

272 

1 • 0396281 2 1 52 

1 .80613262149 

0.  E  0 

1 *73728752132 

328 

329 

7  *306 1 2322 1 4  0 
2*1340364214 3 

5 • 9873230c 1 43 

0#  2  0 

273 

274 

6.15748606151 
l *39517032149 

0*  E  0 

1 *332 1946E162 

330 

331 

2*34213092140 

6*60781232142 

1 • 88691 3oc 1 43 

’  0*  c  0 

275 

276 

6  *20306692 1 3 1 

1 •0444o362l49 

0*  ©  0 
9*9003644© 1 6 1 

332 

333 

7 • 003 54o 1 © 1 J V 

1  .959001 76142 

3  •  ju04  1  o22 14*. 

0*  2  0 

277 

278 

4*671 0284© 1  5 1 
7*5763660© 148 

6*  ©  0 

7 • 1 3 02784 E 1 61 

334 

33  b 

2.068572361  JV 
5*61 18926fcl41 

1 *61284002142 

0*  2  0 

279 

280 

3  »2640B57E 1 S 1 

5  •  .3257785E 148 

0*  E  0 

4.9764087E161 

336 

337 

5 • 7963303& 1 38 

1  #5331 1472141 

4* 5 135051 ©141 

0*  Eg 

3b  3  1 *60779005136  0.  E  0 

354  1 .32789Q6E133  9 ♦ 8 i 4Q07OE 1 3b 

355  3 • 03 1 1 870E 1 3b  0*  E  0 

3M _ 2JL&2H222Z  122-  1  *?£63194E  135, 

357  5 • 87424 1 4E 134  0*  E  0 

358  4 • 96684 1 3E 131  3 *64446 1 6S 1 34 

359  1 ♦0970999E134  0*  E  0 

360  9*1 424003E 130  6 .64429Q3E 1 33 

1*97413835133  0*  E  0 

1 *6 146228c 130  1« Io69b30cl33 

363  3*4215d37c132  0*  E  0 

364  2*7462^605129  1*97366976132 


36b  b  *7 1 02721 El  3 1  0*  E  0 

366  4*49695165126  3 *2 1 46076F 1 3  I 

367  9*173742  9E 1 3  0  0*  E  0 

368  7*067461 9  £  1 2  7  b *03669 1 3E j 30 

369  1 .4162629E130  0*  E  0 

370  1*07477196127  7 *S996574E 1 29 

371  2*1 0934 ObEl 29  O*  E  0 

372  1  *5676465E126  1  *  1 C25443E 1 29 

373  3*01 696 62E 128  0*  E  0 

374  2*1  9056455  125  1  *5360075E  1 26 

4*  14037475127  0*  E  0 

2  *  9637 1 22E 1 24  2 *0622392E 1 27 

b  « 4o 1 66 1 6E 1 26  0*  E  0 

3  *  6366 36 9E 123  2 *6569206E 1 26 

6*  ^5643475125  0*  “  E  0 

4*  /753473E 122  3 » 2876S 1 7E 1 2b 

6*46219615124  0*  E  0 

5  *  703502 3E 12  1  3 *90633 1 7E 1 24 

383  9  *92495786 123  0*  E  0 

364  6 ♦ 5375 1 3 1 E 1 20  4 .43422S3E 1 23 

1 • 1 142752E123  0*  E  0 

7*1 664  J2bE 1 1 9  4  *6723431  El  22 


b 

6 


36/  1*1 9vu  1  1  1 E 1 22  0*  c.  0 

366  7*b7*O0Oo51 1 6  b • 1 1 064b4fc 1 2 1 


369  1 *23tibO03tl2l  O*  E  0 

390  7*65662065117  5  *  137931 6£ 120 

1*22501435120  0*  E  0 

7*41422635116 


r.TW»ir/w:  Bra*  i  wm 

— flL* _ fc _ Q _  i 

3*2b2bol  3cl  l  t 

2* 1 16644451 1 4 

4tboQ3ib35L13 

—Oji _ L _ 0  .  - 

2  *4072  005E 1 1 0 

1  *5bU9l2uc.i  1  3  ! 

u  » _ E _ Cl _ 

1 •7G0l34*tl09 

1  • G*5390hc  lie 

RFr^nRfwR|f|| 

0* _ c  u 

7  *350*ouCc  1  06 

V • 04  9  3o 2 oLiOd 

4 • 494  OuJbc lOo 

2 • o560/o9cl Oo  | 

5.6765873E107 

0.  c  0 

2  *6 1  <4  7434 E 1 04 

1 • 6524 1 66c 107 

3 • 16427565 1 06 

0.  c  0 

1 *4466**95 1 03 

9  •  09662  965 I  Ob 

1  *  7067636c 1 05 

0*  c  0 

7  *603  /03 1  El  0  1 

4*  76006b  IE I  04 

6*  /436965c  103 

Oi  •  c  0 

3.7y63343cl 00 

4  *'<2b  I  1609c 102 

2 • 3648631c 1 03 

at  e  o 

I • 79747276  yy 

1  .‘yo97ioy£ioi 

•til <4 39906 < 02 

0;  to  | 

8 *06569905  97 
b. 55763325  99 

4*  9769927c 1 00 

0.  E  0 

3*42660325  96 

2* 1 046040E  99  : 

3  •  5364344 E  98 

1  *3771 1135  9b 

1  .36162405  97 

...  0  •  E  0 

6*41614035  97 

0.  5  0 

Di£cVUbl4t  V3 

5*09743155  9b 

3 • 1 0 1 61 62c  *0 

0.  c  0 

1 *87403665  92 

1 • 1 349733t  s >6 

2*01432035  09 

1 • 20074b 1 5  92 

l*/94653oc  91 
6*0261 106E  d7 

0*  E  0 

3* 599 59 03c  *0 

5.2042364t  89 

1  *69298626  86 

1 *4<60895li  88 
4*46016365  84 
3*61062005  06 

1 • 1004037c  83 

0*  E  0 

<•00667988  UV 

6  •  E  0 

2  •  64  0 1  Ob  be  8  7 

0*  E  0 

6*48308632  bo 

0.6128U60E  84 

‘  0#  E  0 

2*8369661 E  81 

1 *91 89700E  83 

1*488232 IE  84  < 

0*  fc  0 

5  *45920745  79 

6*02611065  67  3*b99b903c  *0 

5*20423645  69  0* _ 5  0 


1 • 1UQ206/&  63 


461  6 • 559671 9E  70 


463  7.8537187E  60  0« 


469  7 • 77 1 7690E  62 

470  1 >3941 7b3E  69 


471  6  •  3674 290c  60  0*  E  0 

472  1 •0B4bU63£  57  6»0114741E  59 

473  4  *69722 1  BE  58  0*  E  0 

474  7 » 5779622E  54  4*1827903E  57 

475  3*1 046879E  56  0  •  E  0 

476  4  *  7322423E  52  2*6010630C  55 


477  l*8291b49E  54  0*  E  0 

478  2 • 326 1 Q57E  50  1 >437391 7E  53 


479  9 • 5464666E  51  0.  E  0 

460  1 •286B9Q6E  48  7*01441222  50 

481  4 • 3845603E  49  0*  E  0 

482  5.5292603E  45  3*0013|01E  48 


2 • 066294 1  £  43  1*1169599 £  46 


4bo  b*OS4o752E 


AA _ 0. _ E _ 0, 

hQ  3.5Q2 4607E  h3 


468 


1 *82  /5742c 


j8  9*  798  a  942E 


_ u , 

40 


ItoL 

490 

A2J— 

492 

AftL- 

494 

A*£ll 
490  ' 

497 

498 

ayy— 

500 

£Q.l _ 

502 


504 

505 

506 

507 
506 

509 

510 
51  1 
512 


3 S 

4*22751  /on  Jo 
9 • 6999449E  36 
6*1 160149c  32 

l»pfr64301fc,  ,34 
1 *271 8076c  30 

2t9Qbl^Vfc.  31, 
1 1 bl h5c  27 
2  *62356 / OE  28 
1 *54947232  24 

1 • 1 3461 5 7E  21 

±±Smi222!LjtiL 

5 • 9796674E  17 
6*08726942  16 
2*131 389 1 E  14 

1  *  72883B9E  15 

4*66924bbc  10 
2,041571 7b  1  1 
5 • o 1 62444E  6 

2  *  2064978b  ’7 

0*  c  0 

5,1  199998b _ 2_ 

1  *  OOOOOOOE  O 


Ji-t _ & _ liL 

c*co72o28c  36 

-Qj _ 9 . 0 

4*31o935bc  5b 

JJji _ & _ 

6* 7357403b  32 
iLt _ c.—  0 

b*394962dc  29 

-£• _ E  0 

b • 1 403923E  26 

JLj _ 1 _ £ _ fiL 

5*93b0620E  23 

iLs _ E.„Q 

3* 1 !65d30E  20 
0*  E  0 

1*1 064267E  17 

0* _ b  0 

2 • 4247606b  13 

O'* _ .  E  0 

2 • 82431 7 1 E  9 

_ fe _ SL 

1 • 3061 599c  5 

0  • _ E  Q 

0*  E  0 


-2kk- 


bWROR  HATE  tGUATION  COEFFICIENTS 


HAMMING  SINGLE  ERROR  "CORRECTING 
/DOUBLE  ERROR  DETECTING  COOES 


DETECTION  WITHOUT  CORRECTION  OCCURS  IF  CHECK  WORD  IS  NON-ZERO  AND _ 

overall  p  Art  ty  ChE'Ck ' Is ~ s A t rs?TEB"*«  OS’”- "IV'ChSECk" word  is  zero 

AND  OVERALL  PARITY  CHECK  IS  NOT  SATISFIED*  _ 

1 

_ i 

I 

**  A  <  1  ) 

6(1  ) 

I 

Ad) 

6(11- 

n  ■  a 

V 

0 

o*  e 

0 

0*  E 

0 

5 

2 . 3999999 E 

1 

7#  OOOOOOOE 

0  I 

1 

0.  E 

0 

l.OOOOOOOE 

0 

6 

0*.  E 

0 

2 *79999996 

1 

2 

Oa  E 

0 

2  *7999999E 

1 

7 

6  *  99999996s 

0 

l.OOOOOOOE 

0  .  _ 

3 

2.4999999E“ 

T‘ 

"7.0000000E" 

0 

8 

1 tOOOOOOOE 

0 

o*  e 

0  I 

4 

6.9999999E 

6 

5.5999990E 

1 

* 

X 

N  «  16 

~  0~“ 

0.  £ 

TT 

0*  E 

0 

9 

5 • 07999946 

3 

7* 1499?  966 

*  1 

l 

0  •  E 

0 

1 tOOOOOOOE 

0 

1  0 

2 • 79999976 

2 

7.5599993b 

3  * 

2 

0.  --  e  - 

“<r; 

"!•  2(50  OOOO  E  " 

~'2 

1  1 

2 1  750 9998 E 

3 

2*72999986 

2 

3 

1 .3299999E 

2 

3.4999990E 

1 

12 

1 • 05000006 

2 

1 *67999986 

3 

■  -•  -4 

3»4999998E' 

T' 

'1T6799998E' 

~3" — 

- T3 

*’'3’*  9W9990E  2“ 

3.4999998b' 

1 

3 

I .3439998E 

3 

2 • 7299998E 

2 

14 

0*  E 

0 

1 *20000006 

.2 

6  "" 

1  .6799999E — 2 - 7Y5599995F" 

”3 - 

Jl  15 

— r.soOTwor 

~ r 

T.OOOOOOSb 

0 

7 

4.8449994E 

3 

7* 1499996E 

2 

16 

1 .ooooqooE 

0 

0*  6 

. . | 

“  8 

4*3499996r~ 

2' 

*  ~Y*  19 999 99E*“ 

““4 - 

1 

N  B — 32 - 

0 

0.  E 

0 

0  •  E. 

0 

1  7 

2*90031 06E 

a 

1 .76788326 

7  1 

1 

0  •  ~E~ 

~Q 

~1  .ObOOOOOE 

0 

18 

8 . 280  7 1 076 

6 

4. 5671424b 

8  I 

z 

0*  £ 

0 

4.9599999E 

2 

19 

1 .9778178b 

0 

1 • 0855423b 

7 

3 

6.0499997E"* 

2 

~iV549^999E* 

~2  ~ 

20 

4*41 48644E 

6 

2* 18729026 

8  f 

4 

1 • 5499999E 

2 

3*47 1 9996E 

4 

21 

8 • 0760564E 

7 

4*03201456 

*  _ 

5 

3*460799 7E~~ 

~tr~ 

■"■fiT*  292999 AH'" 

3 - 

^r*3830958E’ 

6 

~~6V2500456ET" 

7  * 

6 

5 • 2079994E 

3 

0*704 1392E 

5 

23 

1 #91491 92E 

7 

8*76524906 

5 

7 

7 • 7330492E 

5 

1 *05102986 

5 

24" 

2 • 4704497E 

5 

1*01070386 

7  t 

0 

8.2614992E 

4 

1*01 87838E 

25 

2  #4873677E 

6 

1*05102906 

5 _ J 

9 

0 *02307906 

6 

0*765249OE 

5 

26 

2*25679986 

4 

8*784 1 59 It " 

S 

to  _ 

6*2867992E 

5 

6.2500456E 

7 

_ _ 27 

1 #604 7498b 

5 

6*29299966 

3 

1  1  ‘ 

4.4231 802E 

7 

4.0320145E 

O' 

2~8~ 

1 • 0830000b 

3 

3*47199966 

4  1 

12  _ 

2 .64891  BSE 

6 

2 • 1 872902E 

8 

29 

4* 1999V97E 

(  3 

_ 1  *54999996 

2 _  1 

13* 

1 . 3073633E 

0  ‘ 

1 • 0855423E 

7 

30 

0*  E 

0. 

4* 9599999 E 

2 

1  4  _ 

6.4405589E 

6 

4  *567 1 424E 

0 

_  31 

3»0999998E 

,  1 

1 *00000006 

_0. _ f 

15 

2*5801 27 IE 

0 

1 •7678832E 

7 

32 

1 *00000006 

0 

0*  £ 

0  1 

1  6  _ 

9*3901 135E 

6 

5*82  284056 

a 

X 

N  ■  _ 64_  _ 

T 

0  "" 

0*  E 

0 

0*  E 

0 

6 

8 • 6492779E 

6 

.  4#  3369703E 

9  1 

1 

0*  E 

0 

1 tOOOOOOOE 

0 

9 

4  *  1 21 61 23E 

9 

_ 4#  3032 1 57E._ 

8  -*■ 

2 

0*  E 

0 

2  tO 1 S9999E 

3 

10 

3#6977662E 

6 

1 .4910661b 

II 

3. 

2  *5729990E 

3  • 

6*50999996  . 

2 

_ iJL. 

U3343363E  >1 

_ 1  • I618682E. 

.to - :I 

4 

6 • 5O99990E 

2 

6«2495995E 

5 

12 

9*62 1 8882E 

9 

3.2328973b 

12  1 

5 

6 • 8596794E _ 5 

—Lt  191.3300 E_ 

..a..  „ 

_ 13- 

_ 2.474 86034 E _ 1  P _ 

||  ... 

6 

1 *0936798E 

5 

7*38077686 

7 

14 

1 *63S68S2E 

1  1 

4*71 07946E 

13  •  . 

7 

7  •  4475040E .. 

.7.. 

_  9-  •  70 65 QZ  OJS  .. 

.4.0L _ 

_ Ift 

..J3A.8iJE721j06L.i  3 

..  _2  •  492403.TE._12-- _ | 

I 


j  '  -245- 


I 

i 

A<  1  ) 

Li(  i  ) 

i 

M  (  1  ) 

u  ( 1) 

i 

16 

1 

•9083 105E 

12 

4 •8089357E 

1  4 

41 

9.1079964E 

16 

2*2925216c 

lb 

17 

3 

.7077297E 

14 

2. 1552653E 

1  3 

42 

8.23874046 

1  4 

7.909199bE 

16 

i  is 

1 

•5027722E 

1  3 

3*54541 14E 

15 

43 

2*69670706 

16 

6  *  423 1 226C 

14 

i  19 

2 

• 6036 1  5 1  E 

15 

1  .3624605E 

14 

44 

2*1 075B756 

14 

1.9313161c 

16 

20 

9 

•5799435E 

13 

1  •  93  1  3 1  6 1  E 

16 

45 

5*9000 1 236 

1  b 

1  • 362  ho05c 

14 

»  21 

1 

•3498593E 

16 

6*423 1 226E 

1  4 

46 

4  *04406226 

1  3 

3.04541 14c 

15 

i  22 

4 

•31S5349E 

14 

7.9091995E 

1  6 

47 

9  •  07044  1  Be. 

1  4 

2 • 1 552653c 

13 

*  23 

5 

•  2548893E" 

16 

2.2925216E 

1  5 

48 

5 • 72493 1 4 t 

1  2 

4.0009357c 

14 

24 

1 

• 4686466E 

15 

2.4673263E 

17 

49 

l  .10099266 

14 

2.4924037c 

12 

i  25 

1 

• 5557862E 

17 

6*26622556 

15 

50 

5*041 7331 t 

1  1 

4.7107946c. 

13 

1  26 

3 

•8184809E 

15 

5.9215830E 

17 

51 

1 *01 82^09 E 

13 

2 • 0526330c 

11  . 

1  27 

3 

•5366096E 

17 

1  •32  28698E 

16 

52 

4* 16940476 

1  0 

3.2328973c 

12 

20 

7 

•64784 1 0E 

15 

1  .  1012890E 

1  8 

53 

5 • 985433 1 E 

1  1 

1  . 1618682c 

10 

I  29 

6 

•2150948E 

"17 

2.1  700277E 

1  6 

54 

1 • 9967937E 

9 

1 .491 066 1 E 

1  1 

1  30 

1 

•  1867338E 

16 

1 .5949704E 

16 

55 

2.29A’864bE 

1  0 

4.3032157E 

8 

31 

8 

•  481 957 1  E 

1  7 

2 .776702 1 E 

16 

56 

6 • 0544945E 

7 

4 .35697055 

9 

32 

1 

•4317370E 

16 

1  .8039887E 

18 

57 

5 • 3703375E 

8 

9.706S020E 

6 

1  33 

9 

.01 12688E 

1  7 

. 2 .776702  I  E 

1  6 

58 

1 • 0572238E 

6 

7 . 30O7767E 

7 

j  34 

1 

•3449650E 

16 

1 .5949704E 

16 

59 

6*81941 03E 

6 

1 .19133006 

b 

35 

7 

•4560795E 

17 

2. 1700277E 

1  6 

60 

9.7649993E 

3 

6 • 2495995c 

5 

,  36 

9 

•0329383E 

15 

1  .  1012890E 

1  a 

61 

3 • 6439997E 

4 

6*50999996 

2 

37 

4 

•  7974  699E 

17 

l  .322869BE 

1  6 

62 

0*  6 

0 

2.01599996 

3 

i  30 

5 

.5808567E 

15 

5.92 15830E 

1  7 

63 

6 • 300000GE 

1 

1  .OOOOOOOE 

0 

39 

2 

•  391 9356E 

17 

6. 2662235E 

15 

64 

1 • OOOOOOOE 

0 

0*  6 

0 

40 

2 

• 4477445E 

15 

2.4673263E 

1  7 

N 

*  128 

0 

0 

•  E 

0 

0*  E 

0 

30 

2 • 82379 1 6E 

26  * 

1  .5301 1056 

29 

1 

0 

•  E 

0 

1  .OOOOOOOE 

0 

31 

1*191 1359E 

29 

3.8O87707E 

27 

2 

‘0 

•  "  £ 

‘“o' 

8.12  7 9998 E" 

3 

32~ 

2*0063401 E 

"aiT* 

X  .46626 1 16 

30 

3 

1 

•0604999E 

4 

2.6669999 E 

3 

33 

1  •  1 159642E 

30 

3.35065O5C 

2b 

4 

2 

• 6669998E 

3“ 

*1  .05026556 

7 

34 

2.49274026' 

~20' 

’  1 • 1910272c 

31 

5 

1 

•2155470E 

7 

2.0669248E 

6 

35 

ti*  0666062E 

30 

2 • 5203990c 

2V 

6 

1 

•  9042  478E 

6 

~5 .30  1  2 79 BE 

9 

36 

1 .03122726 

~29  ~ 

~  8 . 2690 1 03c 

31 

7 

5 

•7867Q26E 

9 

7*3840267E 

8 

37 

6*01 16510E 

31 

1 .61895926 

30 

0 

6 

• 98 1 3629E 

~8~ 

T.  4  1  053 2  2  E 

T2 

30- 

f#  15097Q8E* 

*30 

~4 .92376626 

"32  ^ 

9 

1 

•4578577E 

12 

1 .4892733E 

1 1 

39 

3 • 49697 1  BE 

32 

8. 94688005 

30 

.  J  Q 

1 

•3845528E 

i  r 

2*25  O7307E~ 

14 

40“ 

6*  220 8773 E 

30 

~2*  5281 645E 

33 

1  1 

2 

•2323367E 

14 

1  .901 1250E 

.13 _ 

_ 4  1  __ 

1 • 7534  680E 

.33.. 

4 . 2726806E 

31 

. 12 

1 

• 7377477E 

1 3" 

2 .3540680E 

V  6 

"42 

2 • 9040875E 

31 

1 .12402016 

34 

1  3 

2 

.2651 754E 

16 

1  .6t5397B7E 

15 _ 

_43 

_ 7*  610091 9E 

33  _ 

_  .1*7701  1055 

32 

1  4 

1 

•4859963E 

'Vs' 

1 .7254542E 

.18 

"44' 

"V* 175 4639 E* 

32" 

4*34280506 

34 

15 

_1 

•61 57876E 

_ 1  .*03  255 5 2  E 

1  7 

_ 45. 

_Z  *068915661 

_34 _ 

_6*  303 1 2566 

32 

16 

9 

•  1 155268E 

1  6~ 

9*26 1 3750 E 

19 

46 

4*1 390579E 

32 

1 *46270706 

35 

1  7 

8 

•4565274E 

.19. 

_ 4 .8044 1 87E. 

.18 _ 

_ _47, 

_ 9  *423842 1 E. 

„.34 

„2. 00941496, 

33 

18 

4 

•  1663316E 

18 

3.7&26604E 

21 

48 

1 • 27 1 5B26E 

33 

4*30642736.  35 

19 

3 

•3541 406E 

21 

1  •7152617E 

20 

49 

2.  *  7044^23E 

35 

5*536 1 43 1 6 

33 

\  20 

”  1 

•4606526E 

'‘26' 

1 .1072184E 

Y5 

“So" 

3*4 1 68 382 E 

~33  ~ 

1  •  1 1088245 

36 

!  _ _ 21 

.  1 

• 03401 67E_ 

.23. 

_ 4  • 8076334E. 

21 

_ .51. 

_ 6 • 7966 1 36E. 

_35_ 

,1*33779265. 

.34 

22 

,  4 

•01 8881 OE 

21 

2.9695077E 

24 

52 

8*  O476509E 

33 

2*51 5B220E 

36 

*  .  23 

/  2 

•5282255E 

.2.4. 

__.I  •0776320E. 

.23 _ 

.—  53 

...1  *49865166 

_36_ 

2  *  8406250E 

34 _ 

24 

8 

• 8399496E 

22 

5  .9Q75923E* 

25 

54 

1 • 6644285E 

34 

5.0 1 05467E 

36 

25 

4 

•  9Q44  347E_ 

25. 

_ L*96JL290„IE, 

24 

_ 55. 

..^•9O41069E, 

.36_ 

,b«  3082384E 

34  _ 

26 

l 

•5782256E~ 

24 

9 .06 7 552 OE’ 

26 

56 

3 • 0273547E 

34 

8*70797815 

36 

I  ‘  .  ....  .  .  27 

.0 

•0328982E.26. 

.2  *935229B£ _ 25 

— 57- 

—.4  *95279776 — 36  — 

.0*74063316 

J4 - 

26 

2 

.31 60797E 

25 

1  .3446496E 

26 

50 

4.0403197c, 

34 

1*35006706 

37 

29 

1 

•0704 736E 

28 

3. 65 0963 OE. 

26 . . 

59 

._.7..441£214  e. 

,36  _ 

1*26946076. 

3b _ 

A  (  1  > 


i  ) 


-246- 


I  A  <  I  )  ti  (  l  )  I 


60 

6 

•8431 065E 

34 

1 

•8540473E 

37 

95 

3 • 149b223t 

30 

3 . 3 500 50 3 5 

2U 

61 

9 

.85725455 

36 

1 

*62740695 

35 

96 

8*65902045 

27 

1.4  oc>26  112. 

30 

62 

8 

.5184579b 

34 

2 

.23  3484  7E 

37 

97 

3.6460128E 

29 

3.80077875 

27 

63 

1 

•  1519284b 

37 

1 

•B423945E 

35 

98 

9.22438605 

26 

l . 5301 185b 

29 

64 

9 

•3559102E 

34 

2 

•3764012E 

37 

99 

3 .56624925 

20 

3.6509630b 

26 

65 

1 

•1879126E 

37 

1 

•8423945E 

35 

100 

8.271 71345 

25 

1 .34464965 

28 

66 

9 

•0680360E 

34 

2 

. 233484  7E 

37 

101 

2.92445185 

27 

2.9352290c. 

25 

67 

1 

•08108125 

37 

1 

•  62  74069E 

35 

102 

6  •  1 V 1 5003b 

24 

9.0675520c 

26 

68 

7 

•75561 14E 

34 

1 

•8540473E 

37 

103 

1 .99239485 

26 

1.96129015 

24 

69 

8 

•  680929 1 E 

36 

1 

.2694607E 

35 

104 

3.83064475 

23 

5.90759235 

2b 

70 

5 

•8514204E 

34 

1 

•3588670b 

37 

105 

1  .1  157700E 

25 

1 .07763205 

23 

71 

6 

. 1478059E 

36 

8 

.740633 1 E 

34 

106 

1 .93636995 

22 

2. 96958765 

24 

72 

3 

.89231 32E 

34 

e 

•7879781 E 

36 

107 

5.071 6775E 

23 

4 .8076334b 

21 

73 

3 

•8372757E 

36 

5 

•3082384E 

34 

108 

7 . 8875237E 

20 

1 .18721845 

23 

74 

2 

• 2808837E 

34 

5 

.01 05467E 

36 

109 

1  .04^96822 

22 

1 .71526175 

20 

75 

2 

• 1089420E 

36 

2 

•8406250E 

34  " 

lie 

2 .54609 l 6b 

1  9 

3.76266045 

21 

76 

1 

• 1761962E 

34 

2 

•  51  58220E 

36 

1  1  1 

5.2559589E 

20 

4 • 8044 1 875 

18 

77 

1 

•0193352E 

36 

1 

•33 7 792 6E 

'34 

1  12 

6.3808686E 

17 

9.261 3750E 

19 

78 

5 

•  3302675E 

33 

1 

•  1 1 08824E 

36 

1  1  3 

1  . 1497663E. 

19 

1 . 0325552b_ 

17 

79 

'  4 

•  3264  09 1 E 

35’ 

5 

.536 143  IE 

33 

114 

1 *21 002565 

6 

l  .  7254542b" 

16 

80 

2 

•  1  193047E 

33 

4 

.  3Q64273E 

35 

1  15 

.1  .07403535 

17 

1 . 6539787b 

15 

81 

1 

•  6095727E 

35 

”2 

.0094 1 49E 

33 

116 

1 *67982282“ 

1  4  ' 

2. 3540680b 

16 . 

82 

7 

•3783206E 

32 

1 

•4627070E 

35 

1  1  7 

2.1911 9505 

15 

1.901  1 250c. 

13 

83 

5 

•2376536E 

34 

6 

•  363 1  256E 

"32” 

1  18 

1  .6337723*5“ 

T2~ 

*2. 2507387c 

14 

84 

2 

•2440675E 

32 

4 

•3428050c 

34 

1  19 

1 .74559135 

1*> 

1  .40927331- 

1  1 

85 

1 

•487031 0E“ 34 

1 

.7701 1 OSE 

"32  ~ 

120 

1 .04720445“ 

l“0  1.41  05 32 2c  “ 

12 

86 

5 

•  9464650E 

31 

1 

.  124020 1 E 

34 

121 

0 . 800051  5E' 

1  0 

7.38482675 

8 

87 

3 

.6728362 E 

33 

~4 

•2726806E 

31 

1 22  ~ 

“4  •  03463725 

”7;" 

“5.3812796C" 

9 

88 

1 

•3685930E 

31 

2 

•52Q1645E 

33 

123 

2 • 5034397E 

8 

2. 0669240b 

6 

89  ~ 

7 

•8655654E" 

"32 

0 

V^TSSHOOTT 

’30”“ 

- 

B".  26  76 9955“ 

’V 

i  »  05826555 

90 

2 

.7260025 E 

30 

4 

•9237662E 

32 

125 

3.281 03975 

b 

2.66099995 

3 

91 

1 

•  4549 1 3 1 E 

32 

~"l 

•6 1 895 92 E 

30 

126 

0\  '  E 

0 

8. 12799985 

3 

92 

4 

•6798030E 

29 

8 

•2690103E 

31 

127 

1  .27000005 

2 

1.00000005 

0 

93 

2 

•3142385E 

31 

2 

•5203990E 

29~ 

128 

1  .OOOOOOOE 

0 

6.  6 

0 

94 

6 

♦8917156E 

28 

1 

•1918272E 

31 

N  256 


0 

0.  E 

. 0 

0.  E 

0 

20 

'8.55827135 

25  ^ 

2*79341975 

29 

1 

0.  E 

0 

1  .OOOOOOOE 

0 

21 

2.6780949E 

29 

1.23106695 

28 

2 

0.  E 

0 

3.2639999E 

4 

22 

l  . 1300992E 

28 

3*35331375 

31 

3 

4.3052996E 

4 

1  .0794999E 

4 

23 

3.1748874E 

31 

1 •3378949E 

30 

4 

1 .0794999E 

4 

"l  .74  101  74E 

8 

24 

1 .21 76934E 

30 

3.3121 2605 

33 

5 

2.0444153E 

8 

3 .44 1 2297E 

7 

25 

3.0986075E 

33 

1 .20535415 

32 

6 

3  •  37322  1  3E 

7 

3.6709350E 

1  1 

26 

1  .  0876437E 

32 

2.73082235 

35 

7 

4 • 0709200E 

1  1 

5.1413609E 

10 

27 

2.5254559E 

35. 

9,' 12257275 

33 

8 

5 . 0008099E 

10 

4.0806335E 

14 

28 

8.1604264b 

33 

1 *90254515 

37  " 

9 

4^*  3630660E 

1  4 

4.4095737E 

13 

29 

1  .  739.8229E 

37 

5.86585908 

3b 

i  0 

4 • 2545484E 

13 

2.7773698E 

17 

30 

5.20136715 

35 

1 • 1318174b 

39" 

,  1 

2.89 1 5232E 

1  7 

_ 2 .43576S2E 

_1  6 _ 

_  31  1.0237039E 

_39 _ 

3  .  235’8096fc_ 

37 

2 

2.331 1063E 

16 

1  .268121  BE 

20 

32 

2  *04397325 

37 

5.8017053c. 

40 

3 

•  1 .2925386E 

20 

_ 9 • 3339084 E 

18 

....  33 

5.1911 1 29E 

.40  . 

.  1.5443636b 

39 _ 

4 

Q.859996BE 

1  8 

4  •  13  r2897E 

22 

34 

1  •  3452854b 

39 

2.5829480b 

42 

5 

4.1361077E 

22 

_ P  *6 1 3  7 832E_ 

21 _ 

_  35 

2.286S804E 

42  _ 

.6.4248121b. 

.40 _ 

6 

2 .460631 8E 

2\ 

*  1 •0039377E 

25 

36 

3.5464 196E 

40 

1 ♦ 0 05750 7E 

44 

7 

9.89391 10E. 

,24. 

—.5.*55B1331E. 

.23 

57 

.8*80989605. 

_43 _ 

.2. 34 SI  52 7E 

A9 

6 

5. 1890383E 

23 

1  .881891  IE 

27 

38 

2.0062049E 

42 

3.4464487b 

"  H  ■  mi  > 

45 

9 

1 .8282923E 

2X 

.  _ 9 • 24  43 77 6.6 . 

£5. _ 

. 39  „ 

.2.9B.739S9E.  45... 

7. 5548 lOOfc.  43 _ 

I 


1 

A  (  I  ) 

_ 

t»<i  > 

.  .  - . .  . 

1 

A  (  1  ) 

Bill 

-  . . 

40 

6  •  4038b 1 b£ 

43 

1 *04o 1 1 34 E 

47 

97 

1  *14507826 

72 

1 .18215926 

70 

41 

8.9649U30E 

46 

2.15920148 

45 

98 

7*3423 1 726 

6V 

4*89088216 

72 

42 

1 .8133917E 

45 

2.B185290E 

46 

99 

3.Q255265E 

72 

3*06 1 03V4E 

70 

43 

2.3926429E 

46“’ 

5.5008227E 

*46  . 

'100 ' 

1 *8772760E 

70* 

1.22548716" 

“73 

44 

4*57685625 

46 

6.7903902E 

49 

101 

7*48346956 

72 

7.4228666c 

70 

43 

5 • 7046  396E~ 

49 

1  .2545209E 

48 

102 

4*49431516 

70 

2 • 876361 6E 

73 

46 

1  .0339997E 

48 

1  .4673802E 

51 

103 

1 *73360525 

73 

1  *  66650 1 8E 

71 

47 

i *2i99eoae 

51 

2  *57 1  1 295E 

49 

104 

1 .00794836 

71 

6*3266 1 40E 

73 

48 

2 • 0990860E 

49 

2.8547570E 

52 

105 

3  «  7629995E 

73 

3.59169276 

71 

49 

2.34B8202E 

52 

4.7522167E 

50 

106 

2.1 185374E  71 

1 *30469926 

74 

30 

3  *  0426 1 27E 

50 

5.0169149E 

53 

107 

7*6b648986 

73 

7* 17261866 

71 

51 

4*08485378 

*53*’“* 

'7. 946 82 4 Ye 

51 

“*1 08"" 

4*17468806 

71 

“2  •52336096' 

“74~ . 

52 

6 • 3636675E 

bi_ 

7.9BBB502E 

54 

_JO?U 

1 *46081586 

74 

J *3436 lObc 

72 

. 53 

6  *43677 1 08 

54 

“l  •  205  B642 E~ 

53 

110‘ 

7*71 5299 7b 

71 

4*5  /U6796cT 

74 

54 

9.56212628 

52 

1  •  1 559547E 

56 

1  1  1 

2*61  44  1  4  b  E- 

74 

2.361 72856 

72  _ 

55 

9*2161 57 1 E 

*55“ 

1  .6649046E 

54 

112 

1 .33769778 

72 

7 • 7968667c* 

“74" 

56 

1 • 3072 1 0 1 E 

54 

1  .523833bE 

57 

1  13 

4.39030366 

74 

3.89640408^ 

72 

57 

1 *2021255E 

57“ 

2  *  096  77  b  2  E~ 

56 

114“ 

2.17650686 

72 

1  *24  633658” 

75 

58 

1 *62991 75E 

55 

1  .834b002E 

56 

115 

6.91940236- 

74 

6*0351  1 678_ 

72 

~~  59 

1*4318 8578 

5t> 

2 »Tl  429736 

56 

fl6 

3.32402898 

72 

1.87062598*' 

75 

60 

1 *8578772E 

56 

2*0213703E 

59 

117 

l • 023752VE 

75 

8*77766608 

72 

61 

‘  1 • 56094378 

69 

2.34701766 

57 

118” 

4*7661 0686 

72 

“2*63670718' 

75 

62 

1 *9401 105E 

57 

2  *04274946 

60 

119 

1 .42219308 

75 

1 • 19909578 

73 

63 

*'  1  *56054798  “60" 

2 

•  46661  188 

58 

120 

6.41703568 

72 

3*49086728 

7o 

64 

1 • 859745 1 E  58 

l 

•8969402E 

61 

121 

1  *85536468 

75 

1 *53667438 

73 

65~ 

1 .4335203E- ST 

2 

•  I  9  7360 1 8 

59' 

122 

8*1  141 Q27t 

72 

4*341 7C99t 

75 

66 

1.6394365E  59 

1 

•6215523E 

62 

123 

2  *,2,7333838 

75 

1 • 6048992c 

73 

”  67 

1 *21208978 *62 

~T 

•  60  33 066 E 

“60 

“  “124"“ 

9 *63678068 

72 

-  5*07329868 

“75” 

66 

1  * 33 1 3474E  60 

i 

•27Q0935E 

63 

125 

2*61641 19E 

75 

2*10094268 

73 

69"9.44B9459c*'62" — fV36T5SZ«"21ErSl - I^6'*n%'B73*0y'r7E^3^bi'b6V9Vb>e~7b 


70 

9 • 9754578c 

60 

9 .302B26BE 

63 

127 

2  *82868968 

75 

2*23591 122 

73 

71 

b • 80 1 6443E 

63 

9*557171 18 

61 

128 

i *12668968 

73 

5.7461 1708 

75 

72 

6*90654928 

61 

6.2619379E 

64 

129 

2 • 8728837E 

75 

2*23591 128 

73 

73 

4*52736378 

64 

6*18961368 

62 

130 

1 • 1 0922 16E 

73 

5.56999878 

75 

74 

4*42460658 

62 

3 • 9Q32204E 

65 

131 

2  «  740991 3E 

75 

2.10094262 

73 

75 

2*79032568 

65 

3*71 443738 

63 

132'  1*02585088 

73 

5*  0732986c 

75 

76 

2*62622328 

63 

2.2557875E 

66 

133 

2*45665458 

75 

1 .85489928 

73 

77 

1  .5943400E 

66 

2.06794B7E 

64 

134 

a. 91 221 09E 

72 

4.3417099c' 

75 

78 

1  *  4459486E 

64 

1  .2101476E 

67 

135 

2*06825468 

75 

1 .63867438 

73 

79 

8*45524138 

66 

1  *069279 1 E 

65 

136 

7.27264038 

72 

3.490tio736 

7*5 

80 

7.3930629E 

64 

6*03273928 

67 

137 

1 .6355009E 

75 

1 • 19909o7c 

73 

81 

4*1 6638328 

67 

5*14  Q4604E 

6b 

138 

5 •5739216c 

72 

2*6387071 t 

75 

82 

3*51396658 

6b 

2*79747608 

68 

139 

1 *21460282 

75 

8*7/786608 

72 

83 

1  • 9094  9498 

68 

2  •  299U3866 

66 

140 

4*01  1  759.08 

72 

l *87062598 

>5 

84 

1 *55418778 

66 

1  *20782598 

141 

8*47014442 

J_4_ 

_ to. 055 1  l^Yc 

72 

bb 

6*147276.48” 

66 

9*58459538 

_ 

66 

142 

2*711 08758 

*72 

1  •  24633655 

75 

86 

6 • 4022067E 

J56 

4*8d9722^8 

69 

143 

5*54552658 

74 

5.6964040c 

72 

. .  BY 

3 *23908798 

69" 

3  *  72392578 

to  7 

144 

1 .71 98970b 

72 

7*79o86o7t 

74 

88 

2*45637278 

67 

1 *82  36655c 

70 

145 

3*40799258 

74 

_j2*  3  0 1  7 26toC_ 

72 

i.  b9 

1 *200b95o6 

70 

1  *34  99  70^8 

bo 

146 

1 .0240306b 

72 

4*57867968 

74 

90 

^  6  *  8o644bb8 

67 

6*58761 O08 

/O 

147 

1 *9os4070E 

74  • 

_1 . 34361 60c _ 

7c 

'  .  91 

*  4  *  1  55 1  7478 

76“ 

4.5694607E 

68 

148 

5* 720B687E 

71 

2*52336698 

*74 

92 

2.9451602E 

j&e 

2*0a97U3et 

jJi _ 

149 

1  *  0633687E 

74 

.J7* 17261668 

71 

* . 93 

1 *34271908 

77* 

1  *4451 bOOfc 

69~ 

150 

2.9979303c 

71 

1 *30469928 

74 

_ _  94 

9.201  .'2323E — 6.6 _ 6.*3Si03.0»^e_ 

-71- 

-  libl 

JSii  39J3B.lj6Z8. 

73 

3  *j3VX6987c- 

*71 

95 

4  *0546b4bE 

71 

4*27339588 

69 

152 

1 *47315522 

71 

6*32681408 

73 

96 

2*68756538. 

,6V. 

1  .82754436 

JP2 _ 

— JLM. 

„2.56.6?.744E..73„ 

;.l*686.bOMic..7JL _ 

1 

A  (  I  ) 

6(1) 

1 

A  <  1  ) 

0(1  ) 

N  ■  512 

.  _  \ 

0 

0*  E 

0 

0*  E 

0 

55 

4»322340V‘e 

73 

/•  /  03 14  1  16 

n 

1 

0.  E 

0 

1 *00000002 

0 

66 

6*92920902 

71 

3*23  / 320  /C 

/  5 

2 

0*  2 

0 

1 • 306 1 o99c 

6 

67 

2  •  92204  1  3C 

73 

•j  •  0uu22  1 

/  3 

3 

1 *73484962 

6 

4  *343499oc 

4 

58 

4  *503 96o l c 

73 

C • 03 1  /0 1  3C 

7  /  ■ 

4 

4*34349962 

4 

2 *oc431 7 1 2 

9 

69 

1  •  8c  o  0  *  1  2  c 

7  / 

3*  05  *44048 

/o 

5 

3  *35280662 

9 

6*61 063662 

U 

oO 

2  *  /0oci*2*c 

7  3 

1*1 ou Jh*oc 

/* 

6 

5  *5©0374  1  c 

fa 

2 • 424 /6UwC 

1  3 

O  1 

1  •  0jjUo4lU: 

/^ 

1  •  /II  304  /Li 

/  / 

7 

2  •  7299  71 92 

13 

3*4j0Uo008 

12 

62 

1  *  bO  / uo.ut. 

/  / 

U*  JUL i JJJC 

uu 

b 

3  *3o3 1 b  / 42 

1c 

1*1 Qo42ooC 

1  7 

03 

b  *  obo  /o2 1 c 

oO 

8 • 8*3 141 3C 

/o 

9 

1 *20612832 

1  / 

1*21  Co2cb8 

lo 

04 

/  *  /  vobooOc 

/  o 

3*1 u8 1 / / 1 c 

oc 

10  - 

1 *1*128602 

to 

3*11 O66302 

cO 

Ob 

2*04.1  /382c 

62 

4  •  388  1  / 3  /c 

08 

1  1 

3»3220bttlt 

20 

2 •  7633bOot 

19 

Ool 

3*  / o42  j40C 

60 

1 • 48oc3c 1 c 

64 

12 

2*7236^/62 

f9 

b • 93o0oc0t 

£.3 

o  r 

1  *  ol 0  /02oc 

84 

1 • >JOy/u4U 

oc 

13 

6*22315462 

23 

4  *40*42622 

22 

6b 

1  •  004.99  >o2 

62 

6*  4o30o63c 

03 

14 

4  *35694652 

c2 

6  •  1 403*242 

£-0 

69 

b • 08 1 o6b62 

83 

U* 1 6J6433C 

83 

15 

8*41670042 

26 

6  *26666bbC 

cb 

70 

7 • 08303962 

63 

2 • o4U 1 Ojol 

6  7 

16 

c #13391822 

26 

8  • J*496co& 

29 

71 

2 • 3U2397  Oc 

67 

3*  2  1 033  /9C 

03 

17 

6 • boO 1 jb7t 

29 

4*79326742 

28 

72 

2 • 77033956 

•Ob 

1 • 0066796c 

O* 

lb 

4  *034 1  1 692 

26 

6*  /3  j  /40bC 

32 

73 

6  •  /joOjjot 

6d 

1 • 1 8  / 4  Oooc 

o  / 

19 

o  *e 1 62 1 942 

32 

3*4271bo92 

31 

74 

1- 1 0 1  8  1  099c 

67 

3 • 699b*63c 

*0 

20 

3 • juuOvoOt 

81 

4*31  oV3b(i2 

3b 

76  . 

3* 1 0to429*t 

90 

4*11 3o2boc 

t)8 

21 

4  • 3299943c 

8b 

1 *97*24922 

84 

76 

3  * 5l 12  1 4oc 

66 

1  *206726 1 c 

92 

22 

1 *69600912 

34 

2  *2o  /cbcoc 

38 

77 

1 *03866736 

92 

1 »  33*39766 

90 

23 

2*24691 46c 

38 

^9*41082192 

36 

78 

l  *13790492 

90 

3*61 702o2c 

93 

24 

6*96606962 

36 

V.  79 8 1942V 

40  " 

79 

3*26369672 

93 

4 • 1 036 1 76c 

*1  . 

2b 

9*67663922 

40 

3*74  2o7 1 6E 

39 

60 

3  *W 7044202 

91 

1* 1349733c 

*6 

26 

3 • 66011432" 

3*9 

3  *58246062 

43 

61 

'9***66731  4  bfcf 

94  • 

1*1 8467 /oc 

93  ^ 

27 

3*61342162 

43 

1 .20192362 

42 

82 

9*9  / 1 7369c 

92 

3* 1 6 1 ol uoc 

*o 

2o'~ 

1  *l9b3"767fc" 

"4F 

T  Vi  1*69  J9  9  c' 

4o 

63 

2 • 693660  *c 

96 

3 • ccbooOcc 

V*+ 

29 

1 •08622442_ 

46 

3  *04807 762 

44 

84 

2  *  7027420c 

94 

U_*  H  i  ol  4  03C 

97 

30  ~ 

3*44 1 4464c~ 

44 

3»001 JjOlt 

46 

86 

/  •  0  9  c  4  H  / o c 

9  7 

6*293071 Oc 

31 

2*90671 63c 

46 

y.isij  w/e 

40 _ 

86 

8*91 7969oc 

jyb_ 

2*1 046040c 

3^  * 

32  ~ 

6  *5792/148" 

'Vo' 

/  • U 1 44 1 222 

60 

"U7'~ 

1  •  /644  09  /c 

**99 

2*  V  1 08*33 C 

9V 

33 

6 *74993652 

50 

1 .99063042 

49 

86 

1  *6/40  1  30c 

>7 

4* *769*c7ci 00 

34 

1  *86794 1 22 

"V* 

r*43/“J*T7V 

63 

ov"’' 

4 • 1 3 1 64 10c 1 00 

4 • 64U042oc 

*o 

35 

1  *37610362 

63 

3*64161 762 

61 

90 

3  •  8334  72 bti 

96 

1  *  1 1 43990c 1 Oc 

^  36“ 

3. 6 7900662 

61 

2  *  60  1  9t>3UC 

66 

91 

9  *2o02o60c 101 

1  •Oil  J2ddiil00 

37 

2*4/419sc2 

60 

8  *04840002 

53 

92 

8*31 67796c 

*9 

2 • 364603 1  cl  03 

38 

6*0761  7b  6fcf 

63 

4  **162  /903E 

57 

93 

1  *  9332345c 103 

2  *  0  900c46c 1 0 1 

39 

_3  *  9d66 /822_ 

67 

9*94003072 

6o 

_94_ 

1 •710Jyi4ti0» 

4 •  / 00505 1 c 1 04 

40 

9*1 *U7 Jc4c 

66 

6*011  4 74'i  2 

bV 

95 

3*91 c3 J4bC 104 

4*  09*  1  1  o  /t,  1  02 

41 

6 ibbJbob^t 

jV 

1 *36481042 

ob 

*6 

3  •  jjo-jjoJl  1  02 

9*0*0 02  9  7c 1 03 

42 

1  *24666*72 

56 

/  •  /uOo  /  Voc 

o  1 

9  7 

/•4400U4461 06 

7*636 1 695U 1 83 

_ _ _43_ 

;7  *26236332. 

61 

1 *06004292 

.oO _ 

96 

O  •  1694693c 103 

1 • oo24l obc 107 

44 

1  *62062622 

60 

v«04ivi jyfc 

63 

99 

1 *34442 /Ocl  0 / 

1 • 33227 1 3C 1 05 

45 

8*41664972 

_63 _ 

1  »d4  0i;330fc; 

62 

100 

1  *090  7909E1Q6 

2*63367396106 

46 

1  *6Vb493uE 

62 

9*64066642 

65 

Toi 

£• JJ  Od  VOdElOd 

2 • 2  7  6 1 66  6c 106 

47 
46 
.49. 
SO 
JSi„ 
5  if 
.53. 
S4 


_6 . 84  02Q3tte^feS _ Lk^2^3JSU^ 


1 *6622976E  64  9* 

Ji*  44738?  1£_&7 _ J.* 

1  *53661306  66 
7 * 369476 5£  6V 
1 *2834 1 53c 
„6  *1 


1 6V6444E  67 

04064272  69 
42j3983E  6U 


JLCU - L«  fa<Ui-^Q4blQ6  4 ,.  6  *Qda?  6  c.1  Oj>_ 

103  3«  7  ('UUiyotl  OV  3»63407yutl07 


_1A4 _ <L*.iatiyttlL4t.lA7-:.7- 

103  3«oa43V36t:i  1 0  3 

JwQ6.._-laA^Ji7;t6JLtXQll_.l 

107  U  •  7J503V<s!£  111  d 


•  34  JdSyOc.  1  1.0_. 

•  dddVltidfclOd 

•jQyjaiiyOit&.ui.. 

•  1 3 5225521  0  v 


9*63237642 


•  1 Ju7c 1  /cl  1 1 


' 

*-  > 

1 

i 

M<  1  ) 

3(1) 

I 

A(i) 

u(  1  ) 

1  1  b4 

6 

•78553462 

70 

2  *878361 6E 

73 

206 

1  •06315042 

5  1 

3*016914 62 

53 

1  03 

l 

•  1 4440406 

73 

7 *4©©6o6ot 

70 

207 

9*7693319© 

32 

4  •  /  ->©  2  1  0  /© 

30 

1  30 

2 

• 926553oE 

70 

1  *22b 4b  /It 

73 

206 

9  •  0960396© 

49 

2  •  634  75  / 0© 

5© 

1d7 

4 

«  /6012362 

72 

■j*Od  10394  E‘ 

70 

~'2oy  " 

5*3303991 2 

51 

2*571 1 2932 

49 

i  156 

1 

•l637ot3t 

70 

4 • 690662 1  £ 

72 

210 

4  «  720433 1 E 

46 

1  *46736022 

31 

159 

1 

•66942766 

72 

1  •1821592E 

70 

21  1 

2*62856422 

50 

1  *2345209© 

4b 

j  160 

4 

•47y2734E 

69 

1 «62 754432 

72 

212 

2*20521252 

47 

O* /9039022 

49 

*  161 

0 

♦64227396 

~TT 

4*273395 »o£ 

69 

213 

1 *16344342 

49 

5  •  300822  /© 

46 

*  1  62 

l 

.»db8304ti 

69 

6 • 39030922 

71 

214 

9*23966292 

45 

2 • 6 1 85269© 

«**.- _ 

163 

2 

•34249006 

71 

1 *44516002 

69 

216 

4*60947322 

47 

2* 1392014© 

43 

|  1 64 

5 

•25006616 

66 

2*08y7832E 

71 

216 

3*45609012 

44 

1 *0451 134© 

47 

I  1  Ob 

7 

•49o949dt 

70' 

4  •56946072 

06 

217 

1  *02  /  /3o9© 

40 

7*bo4ol 00© 

43 

1  loo 

1 

• 62430066 

66 

6  •  367  6 1 OoE 

70 

216 

1  *1509280© 

43 

3 • 44044©/© 

43 

'  167 

2 

•  24 1  bo 1 16 

70 

1 *3499706© 

06 

2  1  V ' 

5*0991499© 

44 

2  •  34  3  1  3©  7© 

4© 

|  166 

4 

•69325716 

67 

1  •6230055© 

70 

220 

3  •  3u ‘4,4  785© 

4  1 

1  •  OUo7bO  /«r 

44 

1  169 

6 

•26692236' 

09 

""  J  *72  3 92*57 1 

0  / 

221 

1 *409oo90t 

4  3 

0*4248121© 

40 

170 

1 

•26666266 

0  7 

4 • 63  9 7229 1 

69 

222 

6  •  76396262 

39 

2 • 302947 92 

Hu 

171 

1 

•62934336 

69 

9*36459336 

66 

223 

8»4i yoi^7t 

41 

1 *5443636© 

39 

I  172 

3 

•16236446 

o6 

1 •20702562 

69 

224 

1  *99076132  *06 

3*601 7053© 

40 

1  "  173 

3 

•96609346 

66 

2  *29963662 

66 

226 

7  *22  761 02© 

39 

3*  2338096© 

37. 

174 

7 

•43650806 

65 

2 *79747602 

66 

226 

3*91 836332 

30 

1  *131*61  742 

39 

17b 

6 

•94179066' 

67 

5.1404604© 

66 

227 

1 *32161 172 

38 

5*  0036590© 

35 

176 

1 

•02647376 

6b 

6*0J©73922 

67 

226 

O  *044  91 66© 

34 

1 • 9023451  © 

37 

*  .  177 

"’1 

•  bd  1  1*37  ©t’ 

"or 

1  •  0~£92?9T¥ 

03 

©©9 

2.073/1 04© 

36 

~V  •  T 22  672 7©  " 

33* 

176 

3 

•2997267© 

64 

1*210  14  /6c 

67 

230 

9*62 1 4ooU2 

32 

2  *  7 J0o©23© 

35 

- 179“ 

3 

•  6789*29  SIT' 

oo 

c.  -1.6  /  946  /  © 

64 

231 

2  •  /oJ79©  1  © 

34 

1 *©0533412  3© 

160 

6 

• 2200022© 

63 

/  -  .33  /O 73© 

60 

232 

1  *4 771086  b 

31 

3*31212602 

33 

lol 

~6 

•06 1 4bov© 

03 

"■3  •  /T443T3e* 

63 

233 

3*0V4 1432E 

32 

-  1 *3376949© 

30 

162 

1 

•06621406 

63 

3*90322042 

6b 

234 

1  *20201 472 

29 

3*3533136© 

31 

.  163 

”T 

•12561606 

6b 

O • 18961 56E 

~02 

235 

2  *67 1 4627E 

30 

1 *23108692 

26 

164 

i 

•76600706 

62 

6*261 93792 

64 

236 

1 *00967602 

27 

2*7934197© 

29 

'  1  db 

i 

•  76691  4  0  c~ 

64 

9*557171  IE 

61 

237 

2*174487  02 

28 

9*244377ot 

2o 

1  do 

2 

•66062166 

61 

9 • 3026266E 

63 

238 

6*66 1 061 52 

24 

1 *081891 1© 

27 

. 1  67 

'  2 

•5374 4 70E 

63* 

1 *36562422 

6*1 

239 

1 *3183847© 

26 

5*556 1 33 1  © 

23 

;  i  66 

3 

•6U07B40E 

60 

1 *27809352 

63 

240 

3*69094772 

22 

1 *0039377© 

©3 

169 

3 

•38634196 

62’ 

1  •608*306*62 

60 

241  ’ 

8*2bl5361E 

23 

2*6137832© 

21 

1  190 

4 

•  7 1 969026 

59 

1 *62155232 

62 

242 

1 *53 1 3136© 

20 

4* 1312893© 

2© 

j  191 

4 

•  1 69749 1 6 

61 

2# 19736012 

39 

243 

2  *23091 31 2 

21 

9*3339604© 

18 

*  . . 192 

b 

•67923616 

66 

__1_*  69694022 

61 

244 

4«7Jyyi60c 

17 

1  *28812182 

20 

’*193 

~  4 

•  72962386 " 

6  6" 

~~£*46681 182 

68 

245 

5 • 9220662t 

18 

2  *43376622 

16 

7  1 94 

6 

•07066836 

2*04274942 

60 

246 

1 *04661882 

15 

2»77  736V8E 

17 

195* 

~  4 

•  9 339611 6* 

5*9 

2*64701762 

67 

247 

1 *06061062 

16 

4 *409873 YE 

13  ^ 

196 

6 

•  u 6 906 666 

2*021 3703E 

69 

248 

_1_*5_60251Q2_ 

1  2. , 

4  *  &&P.6.3  3j£ 

14 

197 

4 

•  72457  22© 

bti 

2.4144V73E 

66 

249 

1 *27033772 

13 

5*141 3609© 

1  0 

196 

_5 

•56420106 

bb 

1 >834500 1 E 

66 

250 

1  *40b50bU2  9 

3*67093502  11 

199 

4 

•14465676 

57 

2*0y677U2E 

66 

251 

8*57069402 

9 

3» 44 1 2297© 

7 

_ £Q0_ 

_ 4_ 

•  6666 07© 

54 , 

1  *823b33bE 

67 

252 

6*80084<ySt 

5 

1 *74101748 

6 

— p 

3~ 

•  32  38  9*0  6  6 

"ST 

1 •664VQ46E 

64 

253 

2*709671 72 

6 

1 .07y4V*yt 

"4”™ 

{  _ 202  . 

_3. 

•  » 

_L*.tiJ5>,yi?^7£ 

JiLfc _ „ 

_264__ 

0*  .  2, 

Ji#.£639VJ9.9.t2- 

H.  _ 

203 

2 

•4312766© 

bb 

1 *20666422 

63 

£56 

2*55000002 

a 

1  *0000000(1 

0 

204 

.  v2 

•496bibb£_££_ 

..7.iya£ia50i;E_fa4 

..0.1 

&•  2 

0 

205 

1 

•6179547E 

54 

7*V46U241E 

51 

-250- 


J 


1 

224 
22  3 
226 
227 
22b 

22  V 

23  0 

*  23 l“ 
232 
'  233 
234 
“  23b 
23b 
2J  7  ' 
23b 
239' 

240 

241 
_242 

243 

244 
24b 
246 

"”247  * 
248 
~249~ 
250 
~2bl”" 
252 
”2b3  ’ 
254 
23a  ‘ 

256 

257 
_258 

259  ” 
260_ 

^26  1 
262 
263  ~ 
,  264 
265 
_266_ 
267 
_268_ 
269’ 
270 
"271  ~ 

272 

273  ~ 

274  . 

275 

276 

277  "* 

278 

279 

260 


A  <  l  ) 

7 «  37636835 147 
4 « 64868845 150 
1 #20972445 148 
7 • 626762 1 £1 50 
1 #92204262148 

1  #22396 1  vtTiJ  1' 

2  «  956q76qc 146 

1  *6544oo48l5l 
4 #4 1 278796 1 48 

2  •  7225249c.  iol" 
6*37721  95c.  148 
5  #o Z287238 1 5  f  " 
u  *  93042662 148 
5  •  53 85 69 5 1 TbT" 

1 #21 186322149 
7 • 1 3 1 30678 \SY 
1 #09364648149 
9#23l5679tT5r 
2  #03096232 149 


8(1) 


I 


A  (  1  ) 


6  (  1  ) 


1 • 156145021 52 
2  #50839662149 
1  •  408~1  1688  132" 
3*00252348149 


"  V  •  6592 6548  r*52" 
3*483227421 49 
"T.8949  722^62” 
3 • 9 1 6431 08 149 
2 • 09752232152" 
4*26794212149 
2*2  o  0266  6  2  To  if 
4  *o07ool 02149 
2 • 3596C96C 1 52 
4  *  b 1 4 7 639c 14  9 
2  •  j681  09 1  5 1 5if 
4*57885165149 


2*30641342152 
4*40343232149 
2*1 o07555c 1 52 
4*10441972149 
2*00  10  6o22 152” 
3*707951  7c  14  9^ 
1 *77969318152 
3 • 246631 02 1 49 


1 *53404242152 
2*7551 2445 M 9 
1 #281 54 d 75Tb 2 
2  *26394*75  1 49^ 
1  •'03759718152 
1 *60613262149 


8# 14155032151 
1 #3951 7032149 

6  •  1  9094848 15 1* 
1.04440368^49 
4 #562095081 51 

7  #57635508  JLil8 _ 

3 • 25770642 1 5 1 

5  •32.5778521 46. 


8*61560058150 _ 281  2 • £54 1 3002 1 3 1  8*04038276146 

~  2%  1581  1468148’  282  *3 #62759462 14b  3# 3633b?22l5i ~ 

1  •40045438151  ^_283  1*31131948131  5#  352  Wyoci  A«* 

3  *4529331  8  1  48  284  2  *494  1  £332  1 4b  c  1 42 1  5* 

2 #20556 148151 _ <6j _ 9# oi 7  /2*02 1 5O  _  3*4j2*^3 1 2I 46 

’ "3 •  35 c  7V9o£T46  "  *  2t>6  V# *3o0090 V 2 1 4u™l  •  40045438 1  3I 

3 *3o33U3C2 1 8 1  28/  6# I  ; >079921 50  2 • 1 5b 1 1 4 6 cl  4b 

b • 04 03b 2 7c 1 4b  ebb  9 #483902 1 21 4  /  0*615600^2150 

4  #9  764087c  1^>  1  289  3  •  7b  764062  1  50  1  •  30uo  1  o9c  1  4b 

””  V#  1  7 02996c 1 4*9  290*’ *b #69 17^992*1 4 /  ““ 3*  1  3508548 1  3cT‘ 

7*13027848151  291  2 #22546668 1 50  7# 66622ob2 1 47 

TV 63 06 7 8 2 2~f  A 9  7“  ‘2  92  3  #3090 54 7cf 4  /  2#  9649  1 37c  i50‘ 

9# 9003644c 1 5 1  293  1 #27335668 1 50  4 • 3^65o4 1 c 1 47 

2  •  2 5620922  1  49  c 94  TV8c>34 OQ  / 2 1  4 7  1 • 63 83 6 29 2 1  5 O 

1 #332194^2152  ^  295  7 • 0^/0881 c 1 49  2 • 39b 1 53681 47 

”2  #Vb  3QTb’u£T4  V"  206"  1  •  0 1 64036c  f 4  <T  8*  9ob  Oc’b  7&T4  V* 

1 #78  780/02  132  297  3# 78804  71  cl  4  9  l • 2Vo623bc 1 4? 

3  #83*709502  1 49*  296  3*  JoVJeO l  U4o  4  *  71*395 * O cThV* 

2  *  1  95  /2262  1  32  -  299  1#9Q 9  Wb5 2-) 49  6#  O0c4cu 1 2 1 4U 

*♦  •  /  / 43*4002  109  oOO  2#  /4o  /u  M&14U  41  j>jhs  #  ;tiny 

£ #669060081 32 _  301  *9 # 91 204 / >c 1 4o  o# 30 a uci oci hu 

5  •  /a  /b4  /  92  1 49  302  1  *  jo0u^40c  1  40  1#1  /0//092I49 

^  i  *703 1  052^1  52 _  ^  w03  4  •  u3 1  o  jc0t  1 46  1  •  59b  / >5 1 2l  40 

S •  72965866749  304  o'#  52  6  2 064 2 1*4 3  3# 6  1 66 9  /1 £ YZiT* 

3  #67469348 1 52  30b  2  * co03ho42 1 40  / • 4936 v 7 1 c 1 43 

7  •  62438296X4 9  oOo  3  •D305o’/oc  1  45  2  •5*9 1  1  3*3£cl  4g^rj 

4  #09865566  1  52  30/  1«# 0*4  1  63  /cc.  1  46  8#402oc33£  1  45 

&*•  3723621  c  1  49  306  IVSc^^oViuTl  457*"]"*  lb’  7*24538 1 4g‘" 

^•^^10  /342 1 32  309  4*60  7bUJ6cl47  1 • 4Vj 1 206c 1 43 

”*8  #V IT2V4^£T4 9"  3T 0  "o *TJ 2  7*9 1 u”c  1  4*4  *5  •  0*0 3v IT Qc I  4* 

4  #oh331  132132 _ 311 _ 1  *  9724  7  /9c  147 _ 6 #359  1  btooc  1  44 

9# 19301 59c 149  312  2 #4904  /7jc 1 44  £ • 09 34 5 63  cl" 4 7 

4#  71626998132 _ 313 _ 8*171  73 36 2 .  1  46 _ 2*61  7733 1  21  44 

9  •  1 9  3*6 1 3  j2  149  314  V*  bT 7*4 4*7 0cl4 4  8*  47760202 146*"" 

4  #64331  158132 _ 315  _3 #27604422 1 46  1  •  04281  J8cl  44 

2  •  9 1  1  29402*1 49  3*1*6"  4 •  oTmSVi 8 1 43~  3 •  *322*034 9c;1 4*6** 

4*4^107348  132  317  1  # 2  7Q 76638 146  4* 01959912143 

6*37236212149  318  1  **53090 192 1  43  1  #25*950  75cl 4 

4*09865362132  319 _ *  •  76tt7  7  7 781 43 _ 1  *49899662143 

7  #62488295  149  320  3  *65032292 1  4 2  4  •  6  i  96674c  143 

_3  *67469352  132  321 _ JL* 7^.15773 8 14 5 _ pj  4076034c  1  44 

6 *72963668 1 49  322  2 • 01 726742 1 42  1 *639091 02I 43 

_^3#  1  9331  63E  132 _ 323  6*0776 2618144  1  *8 6 6 8 3 2 o 2 J  42 

3 *757647 ^c 149  324  6*96500648141  5* 624 3839c 1 h4 

-<•66^66008X5^ _ 3^.5 _ 2>0634u;>P_cl  A^.3.6j •  .36065  ioc  1 4_i 

4*77434662 1 49  326  2  #32339292 1 41  1 • 6o624v02 1 44"" 

j 72268 1 52  327  6  #  7  7  89  / 1 82 143 _ 2 •  QJ 7370c2*  1 4 1 

8*637095081  49  328  7*306  1 23221  40  5*  967 48302 14~8~~ 

726  /38,1  52 _ AMM _ ^•J^L9.0.4002.L48 _ p*352902  72  1 

2.96861062149  330  2 • J42 1 5092 1 4 0  1 • 6509 1 362 1 4 J 

_J„»i4<A^58l32 _ _ 6#  .394.6951  5142 1  #9960b6o2l40 

2 #25626925 1 49  332  7 *  063548 12139  5#  3004 1 622 1 4 £  ’ 

_ f  1  #955 1_72Q5 1 42 ^  3 •  6pc|20  / 0 21  w > 

1  #63007825  1 49  334  2  •  03657238139  "l  •Vlcy* OO2I  4  J'" 

-X#X30 2UU4 21^U _ 3 Jjj__  ±a  * 600 .922 Q1*  141  j  *<>Vy 7  3ojl1_>  3 

1 • 1 7029962 1 49  336  .3 #79633038 l 38  4#3 1 3363 1 ul 4 1 

5  •y;/84p67JiJ  3J„ . #.830 0  /64 Ul .43— 4 •  .612 9.b 0 3 218a. 


I 

I 

I 

I 

I 

I 


-251- 


I 


aci  > 


b  <  i ) 


i 


no  8*9000 1 626  110 
in  1*67053126114' 

112  1*17502076112 

113  2*15503406115 

114  1*48177396113 

115  2*6361  VoltTl  <j" 

116  1 *783882261 1 4 

117  " 3* 129005161 1 7 

1  1  8  2*038264,761  1  5 

119  3 • 3276772c 11 O- 

120  2 *269001 ct 1 l 6 

121  3  «  o0o2  1  o6£T1~9“ 

122  2 • 395630 16117 

123  3*93022T*fcTZ<r‘ 

124  2*422160361 lti 

125  '3*0007963612  T" 

126  2*346463161  19 

~ 1 27  3 •6876931 6X22“ 

128  2*17917106120 

129  3 • 35354136123 

130  1 •94096256121 

131  2 • 9253  7426124" 

132  1 •65660496122 

~  1  33  2*44903496'I2‘5““ 

134  1 *36079456123 

135  *T  •  9*6o4'3Sbt  126 

136  1*07196106124 

~1 37  r*5f960H5t'r27‘“ 

138  8*11235066124 

1 39 ~t  ifzytsr&TBr 

1 40  ^  5 •69974326 125 

1 4 1  8 • 0362431 6128 

1 42  4  •  1 2460040 1 co 

143  5 • 5U 90  7 6 4c 1 2  9 

144  2* 77236246127 

145  3 *03205436 1 30 

_1  46 _ 1  • 793Uoo 1 6 1  2d 

1  47  2  •  00461*1  26 131 

1 48  _ 1*11 6590Q6129_ 

149  1 *40723046132  " 
6*69042606129 

131  6*2731 7706132 

_  1.52 _ 3  •  660l24o6130 

153  4*66407506133 

1  54  _2  •  1  451  7756131 
155  2 *35477406734 

_1  36 _ l • 1 465621 6132 _ 

137  1*34269966133 

^156 _ 5*'j 

139  6  s  60 1 72206 135 

160  ^  2*9480 84 26133. 

161  3*32189026136 

„  162 _ 1 *4 1 

163  i *56433916 137 
164.  6 • 34065652X34 _ 

165  7* 1 07671 7E 137 

166  2  *91887536  i.atL. 


2*11604446114  16/ 

T*30  02  70961  12  “  1 6  U  ' 

2*74484856115  169 

1  *901424161  13 " X  /0  ’ 

3*40069716116  I7i 

X  *  303203 36X14*  172  " 

4*027964961  1  /  173 


All) 

3*11 330826 1 66 

1  *20000 /6C 1  Jo 
1 *31  /  7419L139 
0*2232  /J2Cl Jo 
3  *oU0 03236 1 39 

2  •  0 9  X4  o 4 26 V o  7 
2* 12062odcl4Q 


0(1  1 

1  *  003*.  49  VC  1  Ju 
1*90/  OHoOC 1 w9 

7*  /9oo393cl3U 
6 • Oooo /00C 1 
o*l 4oC->3 vu 1 j7 
j*  16  /4cvjlihU 
1 • 22 06 92 DC 1 00 


2  *OO  /92o06 110 
4  *56302036 1 1 6 
id  •  9 00  9  1  2 4  6  I~1  6 
4*9404ooocl 19 

”X *"I  X?  2~o  V4  6  IT?" 

3*13793166120 


3*1 680625c 118 
5*11064546121 
3*r04"39“l  36Xl  9A 
4*87234316122 
'2  V8980X 45EI20 
4  *4 0422346 123 


174  0*1 16  /  Jl ocl J  / 

175  6 • 07 1 544 1 c 1 40 

176  3 • 0302  V 76c 1 56 

1 77  2 • 96720 1 4c 1 4 1 
T7d  "T '•69700346139'* 

179  1*05370146142 

1  80  3*  62  96343C  1*39 

181  3  *610326  / 6  142 

182  1 *291 73 1 76 14  0 
J83_  1*19870766143 
TB4  4**  2X6  752* 1 6*1 40* 

185  3*841390 1 £t 43 


2*59473386121 
3 • 90633 186124 
"2  • 22 9  fob  26 1 2  2* 
3  *26705 186125 
"Ti&jBoSviK'itT 

2*63692066 126 

’T*7f35U4T06T^^r 
2*00223926127 
X*  10Td0o'2 
1 *53800766120 
dXa9¥375,9dXT2o'“ 
1 • 10234436129 


186 

107 

TbtT 

109 

TvT 

191 

T5*2“ 

193 

w 

195 

Twar 


1 *32675796 1 4 1 
•1  *10999196144 
4*041 4oU2cl 41 
3  *oo40oo9cl 44 
*X*  Xv 03 26 111142" 
1  •  03220/9C1 43 


J *39031306 142 
2*891 10006143 
~9V5j94~0  dO  cT  42~* 
7/*o324o696l43 


197 


2*40069706143 

2*03273416146 


5*69244726 126 
7  *39963  /66  1^29 
'  J**  04  5X34! 3i6  UfT 
3*03669156130 


190  6*413/46/6143 

199  5*20496206 1 4u_ 

200  1 • 6 Jo 306 I u 144 

201  _ 1  *2  / 7 06626 14  7 


2*30261426126 

3*21460/961^1 


1  *ooo2oocc  l2y 
1*973^0976132 
9  *436034261 29 
1  *  16693306133 


2 02  3 *6o2700v6144 

203  3*0322o216147 


1  •  2c046Oucl  4  1 
4*61 29o03L  13©^ 
4 • 3 1 3 3652c 141 
1 • 676 7303 cl J  9 
1 *61 2o400cl 42 
3  •  00820  70 1. 1  39^ 
3*3664 1 o2C 1 4c 
1  * 99000606140 
“X  *'0369X3861  43“ 
6*53290296140 
" 3*987 3  2  30  ©14 3 " 
_2  •  07737026 1^4 1_ 
1  •  OOO2490C  1  4.4 
6*  36003 loci  4 J 
3*024553 9C 144 
1 • 000652OC 1 42 
1 *639091 oc 1 43  * 
Jb*  407 Op  3  46 
4*61  91  60/4  cl 4  3 
l • 4969966c 143 
1 *23933 /3ci4o“ 
4*0l9399lcl43 
~J •  32 2  0  33  0*c  I  40~ " 
1  * 042 Ol joc 1 44 
6*4  /7o020cl46 
2*61  /7521c 144 
2*0  954 3o3c 147 
O • 33*1 006c 144 
5*00  JO  1 1 wc 147 
1  *  4  93 1 ©Pool 43 


o  *47474756  130  208 

6*64429036133 _ 209 


3*05941766131 

1 *64726626152 
1 *92621946135 


204  9* 02220626 1 44 

205  _ O*966j33^20614J7^ 

206  2*04010606143 

207  1 •55003476148 
4 • 46532926 143 

x*jl 


b.a47a672ElJ2 

4»27S*74VEi;j.3 
4_. U_207 0 7 idf  l  J $_ 


2*062^602^134 

ZaS&A&ttSgiAXL 

*»t»VS>7t.S»7fel  J4 
-l-»UH^i4J40EXJU. 
4»306U132ElJb 
A.«6(10.4abUfcljiU.-. 


210  9*461  !j01  7c.  14b 

iSJLl _ 

£12  1 •V41027d£146 

213  _ 1*4046*1 UE 14* 

214  a«d6£j7466bf4o 

U».7.t.¥2bl<&SL_ 
216  7*4(701  v>6£  146 

SL1 — 7.407.0c,  (it1*.. 
216  1 «Jdl 74V7&147 

.220  2*4V31234tl47 

li¬ 
nt  2  4*3J7l VOVc.147 

.JS23 — 2j_*  U>iJ*<lULfcUiti  ~ 


1*13  /2433C 1 40 
„  3  •  40  2  p  2  3  5  c  I4p_ 
2 • 59 1 1 352c 1 4o 
_7*  49  p_b  9  7 ,1  c  1  4_p_ 
5*61 069  / 16140 
JL*iL>L07J7i^icJ  _4p_ 
1*1 7U7769c 149 
^•2.Qi68J6clA.9. 
2*39544796149 
6*60246616146 


4*71 39390c 1 49 
A*  2.706256c*  1.4JU 
0*  9dj9©o7cl 49 
.2  .*  39b  1  336c  l  _4.Y_i 

i*6585029cl30 

1.*.2  30  309X6.1.4 X  . 
2*  904 V  I 3 7c 1 3O 


3* 1 330C33C1 30 
>1  *20001 


■2  52 


1  mC i }  S U )  1  «  <  i  )  D ( t ) 


338 

339 

340 

341 
34i2 

343 

344 

1 

4 

4 

1 

1 

2 
2 

57o70a2£136 
l 436oo 161 40 
1421 70961 57 
bt>9V324t  1  40” 

0507 vv7t i 3  y 
08644262139’* 
67350602 1 30 

1 *2204t>0o6  1  4  1 

1  #c*:  yovtotl  jo 
3*18/42986140 
~  J  •  1 40288  *6  1  b  / 

8 lOjoO/oot 1 5  9 

7  *79008 9 3d 1 36 

1 iVj  /  J4oocl b 9 

398 

590 

397 

590' 

39  9 

*'  400  “ 

40  1 

1 

0 

9 

5 

/ 

'4 

5 

0->0  Jc4o6  1  1  u 

0  9005286 114 

1  1  5 1  /Cb6l  1  8 

1  /  82 iO/ci  1  5 
50  1  clHJJLi  1  b 

l9ob02Vui id 
3*9585836 1  1  4 

*uU  /  V  C  O  0  6  1  1  5 
m  •  Ow  /  VU*4  i  i  / 

•  jU^uUjjU  1  1  4 
-1  •  HUUu  9  /  I  W  1  1  o 

1 • 90 1 42^ 1 6 1 1 b 

2  •  /  440*4856  11b 

1  *8004  /8V6 1  1 2 

34b 

0 

4  1  605906  1  bo 

1  •  do  b  t-4  9  92  1  bo 

402 

3 

25255 1 56 111 

2*11 0044461 1 H 

346 

0 

0839,2006  13b 

4  *o0w42oo6 1  Jo 

403 

4 

b4  14  1 JCU 113 

1 • low  /2l 76 111 

347 

l 

4900  1  43c.  1  0  6* 

4 • JUOO 1 JCC i JJ 

404*" 

~  2 

40 / 2  0056 1 1 0 

1 • 8509 1 256 1 1 8 

346 

l 

oo79378o 13b 

1  •  U484  7^06 1  JO 

40b 

3 

2«j5:j>u  1  c  1  1  2 

0*1 5522586 109 

349 

3 

3366*176'!  ~S1 

9*595  /b5  /6  1  54 

..  406 

1 

/001 5496  1 09 

1 *098890461 1 2 

350 

3 

05409076 134* 

2  *  <26  3397  9E  137 

:  50  \ 

2 

CO492096 1 1 1 

5*  503  9 1 526 1 Oo 

351 

7 

21779256136 

2*062560261 54 

408' 

1 

14513886108 

7*  545289061  1  0 

352 

6 

48578526133 

4  *820707 2E 1 30 

409 

1 

40i^4  1  5b6  110 

3 • 0340/956 107 

.  353 

1 

50485066136' 

'  4*2  /  3  9749 6 Y3  o' 

410 

'/ 

5b09o026i 60 

4 • O 9 0 05 7 06 iOv 

354 

1 

32  /890OO 1 33 

9*81 4 Oo 7 061  3d 

41  1 

9 

53127426108 

2 • 2?8 1 0006 1 Oo 

3D5 

3 

02520026  1  3d 

8  *b4  750 /26 1 b2 

41c 

4 

49408886 1 0b 

2*0550 / 896 1 OO 

356 

2 

o2 1 1 233t 1 32 

1  •  92  05 1  948  1  5*5 

413 

5 

5050  /  922  I  O  / 

1  • 5822  /I 561 08 

35  7 

0 

oo2  Voo  /c.  1  3h 

1  *04  /  tuucc.  i  52 

4  1  4 

2 

oi 4  7 4546 1 04 

1  *  852  4 1 006 1 0  ( 

336 

4 

90054  1  86  1  8l 

5  *04  440 1 06 1 34 

41b 

5 

1  80 0  502 6 1  OO 

/  • o  Jo 1 o9 b 6 1 03 

359 

1 

09495 4 7t 134 

3.06941 76E131 

4  16 

1 

44009996 1 03 

9*09062968105 

360 

9 

i  4240035 130 

6*64429036133 

417 

l 

/034 1516105 

4*0991 1076102 

”,  36  r- 

**1 

97027b It  133 

6.474V4VbET30 

418 

'Y 

60b'7b3ltlQl  ' 

4* 7o05ob 161 04 

362 

1 

6 1  4622o6 130 

1 • 16095306133 

419 

0 

7267926b 103 

2*0900240010 1 

363 

3 

4 1  48o35c,  1  52 

9*4306342612^ 

420 

3 

79633436100 

2*384003161 03. 

364 

2 

/4620o0ci29 

1 *97^08976132 

421 

4 

242b4b2tl'Q2 

l.oi latbtti go 

,-J* 

365 

5 

0991  061 t 1  o"i 

1  *50028526 1 29 

*“422 

1 

/'9  7  4  7276  99 

.1*1 1439906102 

566 

4 

4969b  lot  128 

3*21400786131 

423 

1 

95307756101 

4*64004256  98 

. 367' 

“V 

1  b  b 60  4  o6T3  O’* 

2  •  5 0  2  <J  1  4  26  1  20 

4^4 

*~tf 

0Q5&99W6  9/ 

4*9  76992 7 6 lOU 

366 

7 

06748196127 

5*030891 36 130 

__ _ 420_ 

0 

54009306  99 

2*01069836  97 

• 

369  * 

~Y 

4 154 0906 130 

3*04813456127 

428 

3 

42080326  90 

2*10460406  99 

370 

i 

074  7  / 1*6127 

7*59903746129 

427 

3 

82955046  90 

0*29807106  95 

*  r  371 

“2 

1  052  157612™ 

_bT *0*9 2*4 4T3 1"  120*  **" 

420 

"V 

5  /  7 1  1  1 56  95 

0*41014036  97 

372 

1 

5676405t 1 20 

1 • 10254436129 

429 

J 

3/092126  97 

3*22bo5Q2&  94 

373“ 

3 

0  1  roo046"T2'd'“ 

8*09830906 125 

43urr 

D~ 

<£2y0bl 4E  93 

3  •  1  U  1,0  1  026  90 

374 

2 

19856456125 

1  *53800756128 

431 

5 

0674O96E  9b 

1* 1845/706  9b 

375“ 

’4 

14 02 624 El 27 

1  *10760626125 

432 

T 

6/403886  92 

1 • 1 8497386  9b 

376 

2 

9637 1 22E 124 

2*06223926127 

433 

..L 

7/055006  94 

_4_*  10  jo  i  Jr'ocj  _j>  ± _ 

"~377 

5 

470941 7£ 12V" 

1  *45504/06  124 

434 

6~ 

33)  7s>3 76  9  0 

3*ol / 02U26  95 

378 

3 

8306b0Vdl2J_ 

2  *Obo920od 1 2o 

43b 

b 

80555556  92 

1*88989/86  90 

.'”379* 

0 

y 4 482 O 7 0*12*5  ’ 

1  *83852916123 

45o 

c. 

O 1  H  Jcdju  u  9 

1  • 206  /48 1 6  92 

360 

_4 

7753473d 1 22 ^ 

5  *2o  /oj  1  76  Uj 

4b  / 

1 

/9 152246  >1 

4*11 802506  05 

'"361  ’ 

*~b 

465600  16~1  24 

2*22915526 122 

4bO 

O 

046110,86  8/ 

3*89959086  90 

362 

5 

70350236121 

3*906331 76124 

439 

_8 

1940bb46  89 

1* 1 O / 40006  0 7 

383 

"9 

905547961 23^ 

<2«b94Y33B£121 

440 

T 

09290826  dO 

l.OOuo/Voc  uv 

304 

6 

5375 1 31 E 1 20 

4.4542233E123 

441_ 

1 

4 1 33 191 E  06 

3.21 63S79E *83 

. .  385'“ 

~1 

M2  0*9606  12  3*" 

2 .8980 1 4bE 1 20 

442  ~ 

’  4“ 

4601.0306  04 

2*640 1 Qbdt  67 

366 

7 

168432561 19 

4 .872343  IE  1 22 

443 

_3„ 

►  00385636  86 _ 0* 1 0304856  bo 

387  * 

1 

19740406122 

3.104391 Jt 11 9 

444 

1 

►100205/6  03 

O*4Oj0oOJC  08 

386 

7 

57900086118 

b* 1 1 0b4b4E 1  a 1_ 

_ 

..ft. 

►bVoObOQd  04* 

98009046  0.2  _ _ 

369 

*1 

236078 1 6 121 

3  .  Ibb06tbt 1 1 0 

446 

2 

►53690616  bl 

1 • 400252 1  &  o4 

390 

7 

65882066 117 

b«  13  793  Ibt  UP _ 

44  7 

JL 

91 52 1 5/6  05 

4 • 300 17876  dO 

39l  - 

“T 

22261846120 

’"aVfs'iasiVtTTy 

44d 

5 

►45920746  7y 

3*1  oo  17*706  o2 

392, 

_7 

4 1 42  2636.1.  L6 _ <L»  .94.0^.05  6.  UL9 

_ 4.4.9L. 

21 

►J9/03.Lo76-.O 1  »  •  5^/-bl  4  i.5  6 — /  m _ 

393 

1 

1582 1446 1 1 y 

2  *980912461 1 0 

450 

1 

►  0942/516  70 

O*3o2l33l6  0W 

394 

6 

►  87251  life  1,1b. 

4  *b0  5O2U56 1  1  8 

--45JL,. 

—7  vl  i  .4  - 

_ 

i 


i 

j 

« 

i 

i 

l 

i 

i 


I  At  I )  d ( I  ) 

452  2*0391 926E  76  1*16Q3496E  79^ 

453  1  *350567941  78  3*0b94'4o4E~‘7b~" 

454  3*52o5339E  74  2*03170146  77 

455  2*29759715  76  * b *06822 1 95  /J*" 

456  5 • 64235645  72  J#23/32©7£  /b 

457  3  •  534  730b£  74~~~7*  /6Jl4i*lt""7  l  " 

458  8*33931 17E  70 _ 4  • 76  36227c  /3  _ 

459  5*01564/16  /*  1 Tovi/VOjt  /O 

460  1  *13532696  09  o»4j  71 

401  O*54oo5/Vc  70  1  ob 

462  1*41 983046  67  0*04054276  69 

463  7*05855256  Ob“”~l  *09923526  bo 

464  1*62622116  65  *  9*lo9o*.446  67  ^ 

465  8*501 41916  66  r*d52*33obE  64 

466  1*70038716  63  9*54oOd8J6  65 

467  0*56193526  64~' “T*b4  QXXJOE'b*'" 

468  1*61739226  61  9*04191396  63 

469  7  •  756582  76  *0  2  *  “ 7 YboO 0429 £~60~* 

470  1*39417636  59  7*7o0o7/26  61 

471  *  6*35497056  60  1 *35401046  5o 

472  1*08450636  57  6*01147416  59 

473  ‘  4  •  6880 3 1  06  58  9  *  94 0 bo U  7  c  ‘ob'" 

474  7*57798226  54  4*182/9036  57 

475*  "  3  •  0988  1  27  tT  5  b"‘o  . 54 840oW‘ 53 
476  4*73224236  52  2.6010630E  55 

477“  r* 82565606  54  T.84  FCTTSfeTt* 

478  2*6261  057E  50  1  *437*391  7E  53 

479  9*  527  78726““  5  r  1~*  996~6334 *T ~ 49"“ 

480  1*28689066  48  7*01441226  50 

’  48  r“'**4*;  3759Hrre*“4  v"’-9rr3*2“i^T£““4  6  ’ 
462  5 • 5292603E  45  3*0013101E  48 


1 


1 *75534536  47 
2  * OOO d 94 1 6  43 
©•09/0oo/c  44 

O«uj4of  J(.u  40 

1  •  ol  j uh 8  >  c  4 2  _ 
J"  l  OW 

4  »  juhjJu 1 u  39 
4*22/51  /Oc.  3o 
9* 6809040c  30 

0*1  1801*495"  32 
1  *68313026  34_ 

i  *  2  71  bo  V be"  V0‘" 

2 • 363  55886  3 1 
r*  b  vT5i*4bc  27 
2*61 84 5316  28^ 
1  •  54  947 23c2  4  ~ 

2*221o4o0c  25^ 

1*1348* 1  5  /c  2  1 
1  *0090  743c  62 


b*9/9oo/4c  17 
6*0/53/ /3c  18 

T  •  T  3iot^i6'T4- 

1*723400/6  18 


4*68924886  10 

2*83001 1 0c  1 1 
"  3  *3l  G  24X46  _  O 
2*2vJ2l  /98E  7 


0V  r  b 

5* 10999986 

TSOTUaUTOE" 


J •  O4t>0 77 86  44 
1*11 096996  40 

1  •  i-ul  >«_.>OC  4*. 

J*  jOt^UU/a  <4-* 
Jl  /ntUMUU  5  9 

9* 7>u 1 342c  40 
_j9  *41  08t  1  9c  Jo 

l«cj/4jlUU  5o 
1  *  9792492c  34 
4*  Jlo9o38c  55 
3*42/18096  5l_ 
~o*  /3  j  /403c  56 
4 •  / 9320746  ^  8 
*"o *39498266  29 
5*28886356  25 
8*14059656  20 
4*4P*>4cU2C  22 

5*95oGo2<JC  25 
2.7 0335056  1 9 

8* 1 i uaojwL  2O 
1*2 1252656  1 6 
1*1  bo42o/6  1  7 
5*45003086  U 
”•  42  4  7 0086  1  5 
3 • ol  335086 _ o^ 

£.  •  824 5*1  /iu  9 

4*54549936  4 

~  1~*  306X59  96  o” 

1  *00080006  0 

Tfc  *6  o” 


